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1971-72 FINAL EVALUATION REPORT 



I. EDUCATIONAL CONTEXT 
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The Locale 



The Texas Education Agency has divided the State of Texas into tv/enty 
geographic regions and has created an intermediate educational agency called an 
Education Service Center in each region. The Education Service Centers are 
designed to provide educational services which the school districts, because 

of limited resources, are unable to provide for themselves. The Region One 

‘ • 4 
Education Service Center is located in Edinburg, Texas and serves forty school • 

districts in seven counties in southern Texas (Webb, Zapata, Jim Hogg, Starr* . 

Hidalgo, Willacy, and Cameron Counties)-* This area includes four cities of 

25,000 or more (Laredo, McAllen, Harlingen, and Brownsville) and ten cities, 

• * y 

of 10,000 or more. Datafrom the 1970 census indicated that persons of Spanish 

surname comprise 79% of the population i’n the three major meti^opol i tan areas of' 
] 2 3 f 

the region. * ’ Average (median) income for non-farm persons of Spanish sur- 
name was $3,709 within the three metropolitan areas. This income level is lower 
than the federally designated poverty level of $3,743 for a non-farm family of 
four. These statistics reveal that 49.9% of families of Spanish surname in the 
metropolitan areas fall below the poverty line, while 54.7% of all persons (fam- 

• ily and individuals) of Spanish surname have incomes below the federal poverty 

• level. The primary industry is agriculture \nd'’ related enterprises (packing, 
canning, shipping). 



1 ’ * • 

U.S. Bureau of the Census. Census Tracts: Brownsvil le-Harl ingen-San Benito, 

Texas , ( PMC ( 1 ) -33 ; Washington: U.S. Government Printing Office, March, 197277^ 

2 

U.S. Bureau of the Census. Census Tracts: McAlleh-P harr-Edinburq, Texas, 

(PHC(1 ) -1 26; Washington: U.S. Government Printing Office, March 1'572). 

3 . 

U.S. Bureau of the Census. Census Tracts: Laredo, Texas, (PMC (1 )-l 07 ; 

Washington: U.S. Government Printing Office, March T972). 
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Needs Assessment ** 

Statistical data presented by the -Governor's Committee on Public School. * 

* x * 

Education (1969) indicate that 55% of the Spanish surname* students in the State 

of Texas now drop out of school prior -to graduation. 4 In contrast.,, 29% of the 
* 

Angl.o students dY*op out of school before graduation. Statewide projections in?- 

dicate that by 1974-75 the percentages of dropouts will be reduced to 50% for 

Spanish surname students and 24% for Anglo students. 

Data for the seven counties in Region One reveals that in 1969-70 there were 
... • ( ' . 

16, -558 .children in grad? one, 10,583 in grade nine, and 6,150 in grade twelve. 

Since the school population has been relatively stable within the region for 

the past decade, this would indicate that approximately 64% of the pupils 

graduate from junior high school and only 37% graduate" from high school. In 

\ S | f 

I • 

addition, t V966 elementary school survey of approximately .70% of the elementary 

^ • 

school 'students within Region One indicated'that .29% of the students were one 

♦ 

year overage in grade and an additional 17% were two or more years overage in 

5 * • • • * , 

grade. Similarly, the study indicated that 33%^of the students were one year 

behind grade level in reading skills and 14% were' two or more years behind. * 

According to experienced educators in the Region, the major academic cause of 

% 

the low achievement levels and high dropouts rates of Spanish surname students 
are: (1) their initial lack of the English language skills upon which the school 

curriculum is based, (2) the compounding of this disadvantage as they progress 
through the textbook oriented classrooms of elementary school, and (3) their 
associated lack of understanding of academically related concepts corresponding 

/ 

■ f t # . 

^ Report of the Governor's Co mmittee on Public School Education: The Chal- 

lenqe and the Change , Research Report, Volume I, (Austin, Texas, 1969), p.39.~ 

A. R. Ramirez, Lower Rio Grande Valley Elementary School. Survey , unoub- 
1 i shed report, (Edinburg, Texas: Region One Education Service Center, 1966). 




to the low socioeconomic living conditions of their families. Consequently, 

• «. • -s 

Thes,e students' need a school program which will capitalize on their knowledge 
of Spanish and at the same time assist them in' learning English. * 

I 

% f * * * 

The Schools . 

r - . 

The forty school districts served by Region One Education 'Service Center • 

range from 17,500 ADA to 75 ADA. 6 Only three districts (Brownsville, McAllen, 

and Laredo)"have ADA of greater than 10,000. In contrast, sixteen districts 

* . • 

have an average ADA of less than 1 ,0p0- A 1972 survey of the school . districts 

* * * 

within Region One indicated that 84% of the children had Spanish surnames. 7 

A min.imum foundation pre-school program was instituted, by the State-^f 
Texas in 1970-71 for non-Engl i sh ; speaking students and students between 5 years . 
5 months and 6 years. of age and an income below $3,000. This pre-school program 
will be extended to include all children 5 years of age and older by the 1977-78 
school year. The implementation of this program. has presented the school dis- 
tricts in Region One with serious staffing problems because few of the teachers 
are certified for kindergarten teaching. 

' a - 



/ 



J 

\ 



6 Texas Education Agency, Public School Directory , (Austin: Texas Education 
Agency, 1971). 

\ • * 

7 Texas Education Agency, Fall Survey , 1971 , unpublished report of statistical 
data, (Austin: Texas Education Agency, 1972). 
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The Language difficulties and low achievement levels of many Mexican- 
American, students in Region One (as noted in the needs assesment) formed the 
basis for-establ ishing the Region One Bilingual Project. This program, a‘ 
four-year program for Mexican-American children with little or no knowledge* • 

■of English, is designed to enroll students at the kindergarten level aTid carry 
them through third grade. The Region One Bijingual Project consists’of four 
components: _ w v ' 

1. Spani sh Reading . This course is designed to teach ^ i r sjt ^ear (kinder- 
• ** ) ' - * • 1 

garten) Spanish-speaking students to read- in Spanish. Students con- 
tinue to use -the reading skills as part of the social "education pro- 
gram in first and second grade.. 

, • 

• 2. English As A Second Language . This component consists of a two-year 

sequence of,oral -English instruction (kindergarten and first grade) 
designed specifically for non-English speaking children. . •. 

* 3. Transitional English Reading . This course is designed to use the skill 

• xi , • 

developed by the student* in the Oral English Program and the Spanish, 

r' * * * . 

Reading Program to teach the students to read in English. When com- • 
pleted, it . will consist of -a two year sequential program/ The first 
year of the English Reading Program was developed during 1970-72; the 
second year program is scheduled for development during the 1972-73 
school year. 



*-» 

> . 



• * 

4. Social Education . This component will when completed, consist- of a 



f 



three-year program designed to*teach first, second, and third grade 



students cqncepts about themselves, the school, their family and cul- 
ture, and local history. The^f4jst-year program was developed during 



<s 
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.• the 1970-7-1 school year; the second year program was- developed during 
the 1971-72 school year. The third-year program is scheduled for 
development during the 1972-73 school year. • ; 

* l 

During 1971-72, the Region. One Bilingual Project enrolled 1,301 students Yn 

kindergarten, first, and second grade from five public schools. All participating 

schools were from •' communities within 20 miles of the Region One Education Service 

Center. All. students in' the project were selected by the schools because they had 
• > _ 

Tittle dr no knowledge of the English languag’e. • 

Program Objectives for 1971-72 

1. To field test the first-year Spanish' Reading Program. 

.2. To field test the English As A Second Language Level I and Level II ' 

Programs. • 

3. To field test the first-year Transitional English Reading Program. 

4. To field test the first-year Soci^} ' Education Program and to develop 

and pilot* test the second-year Social Education Program. • 



Historical Background of the Region One Bilingual Project 

The components of the Region 0n6 Bilingual Project areuased on materials 
previously developed by other projects ; * However , substantial modifications of 
the original material s have been made in order to constructs unified program. 

The Spanish Reading Program was adapted using materials- and personnel from 
the Milleret Kindergarten in Mexico City. Since the 1969-70 school year was the 
first year of operation for this program within the Region One- Bilingual Project, 

V 

the major emphasis was materials development and limited pilot testing. During 
the 1970-71 school year, materials were revised and field tested in 36 kinder- . 
garten and first grade classrooms. ,A field test was conducted in. 18 kindergarten 
and 12 first grade classrooms in 1971-72. 



The materials used in the English As A Second Language (ESL) Program are 
an expanded version of the H-200 sequential language pattern materials developed 

at UCLA. from 1965-68 under . funding from the United States Office of Education *' 

0 ' '* 

The ESL component was in its fourth year of operation during 1970-71 (this com- 
ponent was operated as a ESEA Title. Ill project during its first year of opera-, 
tiori)." Level I and Level II materials were field-tested during 1969-70.- Field 
testing of both the level I and Level II Programs has been continued during the 
.1971-72 school year. 

The materials comprising the first year of the Transitional English .Reading 

/ ’ '# 

Program have been developed primarily by the Bilingual Project staff using 

English vocabulary presented in the ESL Level I Program'. The program was in' 

the planning stage during 1969-70. The materials were developed and pilot 

tested in 20 first-grade and second-grade ’Classrooms during the second semester 

r 

of 1970-71 . The program was field tested in 15 first grade and 9 secortd grade 
* • 
classrooms during 1971-72. " 

The .Social Education Program is a modified sequence of English lanpdage 
materials developed by the Southwest Educational* Development Laboratory and 

Spanish language materials developed by the Bilingual Project staff. This 

• * ’ / 

component was in the planning stage during 1969-70. Materials development 

and pilot testing of the Social Education - Level I Program were conducted in 

20 firstrgrade and second-grade classrooms during 1-970-71. During *1971-72, 

, ' \ 
the Level I program was field tested in 13 first grade classrooms. ^At the ' 

same time, the Level II program was written and pilot tested' in two first 

grade and nine second grade classrooms. ^ 



Personnel * 

Personnel participating in the Region One Bilingual Project included 15 

« 

staff members and 42 classroom teachers. 
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. Classroom Teachers . Forty-two kindergarten, first, and second grade 
teachers in five public schools participated in the project during 1971-72. 

Thirty-seven of the teachers . had a bachelors' degree, four had a, bachelors 

/ 

degree plus fifteen hours graduate'Vork, and one had a masters degree. Cer- 
tification of the teachers by the State of Texas was a^. fui lows: 18 teachers 

held permanent certificates, 20 held provisional certificates, and 4 held 
emergency certificates. Each of the four; teachers with emergency certification 
(all kindergarten teachers) was certified as an elementary teacher, but was not^' 
certified as a kindergarten teacher. 

v 

Statistics for the 18 kindergarten teachers indicate that they had an 

average of 4.6 years total teaching experience. In contrast, their average 

/- 

.teaching experience in kindergarten was 2.0 years. The 15 first grade teachers 
had an average of 10.2 years total teaching experience and an afl^Page of 8.2 ‘ 
years experience in first grade. The nine second grade teachers had an average 
of 10.4 years total teaching experience. However, their averaae teaching 
experience in second grade v/as 4.6 years. 

Each teacher was asked to rate her ability to communicate in Spanish. 
Twenty-four of the teachers indicated that they were fluent in speaking, read- 
ing, and writing Spanish. Eight teachers stated that they were fluent in # 
speaking but not fluent in reading or writing. Eight teachers indicated that 
they could "get along," but were not fluent in speaking, reading or writing. 

Only two teachers were unable to communicate at all in Spanish. 

Administrative Staff . The staff for the Region One Bilingual Project 
during 1971-72 consisted of nine full-time and six part-time persons. The 
full-time staff members included the Project Director, Project Evaluator, four 
Primary Supervisor/Consultants, and the Artist/Illustrator. A list of the project 
personnel and their professional qualifications is appended (Appendix A). 
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Organizational Details 

7 “ . ; . 

The Region One Bilingual Project has been funded for 5 years. The present 
> * - 

report is an evaluation of the*, third year of the project. 

' Physical Arrangements, The Region One Bilingual Project introduced the 

Bilingual Program into five public elenentary schools within a 20 mile radius of 

* < ' 
the Region One Education Service Center. -Each of the schools agreed to allow the 

project staff to train teachers in the use of the materials, visit each teacher 

once each week, and conduct a testing program to evarluate student progress. Site 

'aides were hired by the Project Director and house^at each of the five elementary 

/ 

schools. 

Inservice Training . The Bilingual Project staff conducted a 2-day inservice 
program for the teachers participating in the project during August 1971. In 
addition, supervisors from the Bilingual Project staff observed each teacher 
each week and answered questions about the materials. The supervisors also con- 
ducted demonstrations of recommended techniques for using the materials in each 
classroom while the teacher observed. 



Acti vvti es 

Each of the Bilingual Project components consisted of several activities. 
In most instances, the classes were divided into small groups and two or more 
activities were conducted simultaneously. "Each of the Bilingual Project com- 
ponents and the recommended activities are described below. 

Spanish Reading . The Spanish Reading Program was planned as a 40-minute 
activity and was designed for both total group and small group work. The basic 
lesson was introduced to the whole class by tne teacher. Then the class was 
divided into two or three groups (eight students per group) and engaged in the 
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Group I 
(Teacher) 



Gro up II 
XA i de] 



Gro up III 

(Sel f-Directed Activities 



Introduce. Vocabulary 
Introduce Sound-Symbol 
Alphabet Trays and Workbooks 
Form Syllables, Words, and 
Sentences 



Form Syllables with 
Alphabet Trays 
Songs and Games 
Fingerpla.ys 
Filmstrips 
Folk Tales 



Games (Dingo, Dice) 
Mystery Box (Letters) 
Vocabulary Activities 
with Peer-Tutor 



A list of key materials and 'equipment used in the -Spanish Reading Program 



is presented in Appendix B. 



English As A Second Language . The English As A Second Language component 
of the Bilingual Project consisted of a two-year Oral Language Program. Since 
each. program had unique activities and utilized different types of materials, 
the descriptions of the two programs are presented under separate headings. 

> 

ESL Level I and Level II Programs . The ESL Level I Oral Language Program 
consisted of 128 oral language lessons and supplementary materials. The Level 



I Program was designed to present 3 hours of ESt activities per day. The basic 



activities for the ESL Level I Program are: 



Activi ty 



Suggested Tine 



*Basic Language Lessons ' 
*Aural-Oral Language Cards 
*Fi lms tr i ps- Re cord i ngs 
*Song Recordings 
Sharing Time 
Cooki ng 
*Games 
*Seatwork 
★Free Play • 



30. minutes 
30 minutes 

15 minutes ' . 

15 minutes 
30 minut/es 
Every 2 weeks 
20 minutes 
20 minutes 
20 minutes 

*Small Group Activities 




i . 

\ 



A list of the materials and equipment used in the ESL Level I Oral Langu- 
age Program is presented in Appendix B. 



The ESL'Level II Oral Language Program consisted of 115 oral language 
lessons and supplementary materials. The Level II Program was designed to present 



two hours of ESL activities per day. 

II Program are: 

Acti v i tv 

*Basic Lesson 
Sharing Tine 
*Creati9e Writing 
*Games 
*Seatwork 



The basic activities for the ESL Level 



Suggested Tine 

30 minutes 
Jo minutes 
30 minutes 
15 minutes 
15 minutes 



-*Small Group Activi ties 

* 

A list of the materials and equipment used in the ESL Level II Oral Langu- 
age Program is shown in Appendix B. 0 

Transitional English Reading . The Transitional English Reading Program con- 
sisted of 30 minutes of English reading activities each day. The class was 
.divided into three groups of seven to eight students. Each group spent 10 min- 
utes in each of the following three activities-: (1) reading booklets and alphabet' 

trays, (2) phonics (flash cards), and (3) games or puzzles. All materials used 
in the program were developed by the Bilingual Project staff. A list of the 
materials and equipment used in the program ,is presented in Appendix B. 

Social Education . The Social Education component of the Bilingual Project 
consisted of a two-year program '(Level I and Level II). Both the Level I and 
Level II programs were scheduled for 30 minutes each day and consisted of large 
group and small group activities. The large group activities included discussion, 
question and answer, role-playing, and story telling. Small group activities 
were tape recording, drawing, seatwork , cut and paste, and games. 

The Social Education Level I program consisted of a set of eight units and 
supplementary materials. Three of the units were taught in Spanish and five were 
taught in English. The Spanish language units were developed by the Bi 1 i ngual 
Project and the English units were developed by the Southwest Educational Develop- 
ment Laboratory in Austin, Texas. 
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The Social Education Ife ve 1 II program consisted of eight units and was 
taught in Spanish. The units ye re developed by the Bilingual Project. A list 
of the materials and equipment used in the Social Education Level I and Level II 
programs is shown in Appendix B. 



Community Involvement 

The Region One Bilingual Project community involvement program included a^ 

variety of activities designed to. inform' parents, the general' community, local 
% 

university students, and other professional persons of the project's purposes 
and activities. 

• f 

Several techniques were used to inform parents about the project and in- 

lisL- their support and aid. Mothers in each of the communities were selected 

\ 

to serve as classroom aides in classrooms wnere aide's were not provided by the 



school. These Mother Aides were scheduled toTserve for a period of 12 weeks 






(one-third of the school year) and then were to be replaced by another Mother 
Aide. However, only twb. of the schools changed Mother Aides every 12 weeks. 

The other schools preferred to keep the same Mother Aides for a full semester 
because ( 1 ) ' it was time-consuming to train three different aides during the 
school year and (2) it was difficult to find qualified mothers'. 

The schools in the project were encouraged to plan activities to acauaint 
parents with the purposes and activities of the four programs in the Bilingual 
Project. Formal meetings betv/een the project staff and parents were arranged 
in tv/o of the schools. In a third school, parents were invited to observe 
their children and become familiar with the Bilingual Program. Another school 
held an open house to inform the parents about the program. 

Parent committees, formed during 1975^TT"dio provide input into curriculum 
development activities, were not organized for the 1971-72 school vear. Since 



' 4 '- 
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the needed inputs had already been provided by previous committees, the time and 

>r ^ / 

effort required to organizekparent committees was not commensurate with the 
assistance such committees could provide to the project. 

A random sample of ninety-four parents of children in the project were * 

interviewed in February 1972 by a university student hired by the Bilingual Project 

\ * ( # 

Results of the parent interviews indicated that 95 % (89 parents) approved of the- 
project. When asked about the advisability of teaching children to read in 
Spanish, 95% replied that they were in favor of it, 1% (1 parent) was atraid 
it would interfere with her child learning English, and ,4% (4 parents) had no 
comment. When the parents were asked their opinoin of the methods used to teach 
oral English, 95% favored it, 4% were not in favor of it, and 1% had no opinion. - 
Other community involvement activities included television pyografrs and 
presentations to professional groups. Two 30-minute television programs were 
prepared and shown on a local television station. The shows included explana- 
tions of the philosophy and programs in the Bilingual Project and live classroom 
demonstrations of program activities. A 15-minute summary of the project was 

also presented on a statewide program sponsored by Senator John Tower. Add- 

'S, . . 

itional dissemination activities included forty-six presentations and workshops 

to other bilingual projects, university groups, public school groups, and business 

£> 

and civic groups. 



III. EVALUATION OF THE PROJECT 



The Region One Bilingual Project consists of four curriculum components : 

* % 

(1) Spanish Reading, (2) {English As A Second Laivgnage, (3) Transitional 

r '*■ 

English Reading, and (4) Social Education. The 19 j^ 1-72 Evaluation Design for 

the Bilingual Project listed 124'product and- process objectives. Ninety-three 

of the objectives dealt with the. four curriculum components listed above. A 

report of the status' of al Uobjecti ves has already been submitted as a oart of 

% 

the 1972-73 Continuation Proposal. Consequently, only product objectives 

which pertai n . di rectly to student achievement will be evaluated in the present 

» • ' > 

report. -A summary of the present status of the remaining objectives is attached 

as Appendijf C. ♦ 

\ 

^ A. SPANISH READING ' - 

■ 

Objectives ’ , 

1. A set of «eight reading booklets with supporting materials designed to 
teach kindergarten and first grade native Spanish-speaking students to 
read in Spanish was developed during 1969-70 and revised in 1970-71. 

The project staff will conduct a field test of this Spanish Reading 

Program. The field test will include a random sample of at least 50 

i 

kindergarten students and 50 first grade students who are participating 
in the project (no control group will be used since it is assumed that 
children who have not. received instruction will not be able to read in 
Spanish). The evaluation instrument wi 1 1 be a Spanish Reading Test 
developed by the Bilingual Project staff during the 1970-71 school 
year. At least 80% of the students at each grade level will score 80% 
or above on the Spanish Reading Test (composite score). 
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2. An interim testing program based on the revised Spanish Reading Program 
will be established in each kindergarten and first grade classroom’', 
participating in the 1971-72 field test. The interim tests used during 

a 

1970-71 v/ill be' revised on the basis of (1.) the advice of a consultant ■ 
who evaluated -the Spanish Reading' materials in March 1971, and (2)' the 
results of the >970-71 interim testing program. I’nterim tests will be 



A 



given, by each classroom teacher upon completion of each of the ei^ht 
reading booklets. A criterion level of 80" of the students in each 



classroom^cori ng 80% or Setter on each interim test has been selected. 



The Students 



Thi»*ty-four classrooms with a total of approximately 850 students participated 
in the Spanish Reading Program. Eighteen of the classrooms were kinderqarten 

V . • • 

twelve were first grade, and four were second grade. The kindergarten students 
were selected by the schools to participate in the Spanish Reading Program on the 
basis of two criteria: (1) they could speak little or no English, and (2) they 

could speak Spanish. The students participating in the Spanish Reading Program 
were not representative of all kindergarten and first grade students in the schools. 

They were ^students js»ho,in the judgment of the professional staff of the school, 

/ 

would encountered ffi cu 1 ty with the normal school program because of their 
limited facility with the English language. The~Tirst grade students were 
selected for the program because they had been in Spanish Reading the previous 
year but had not completed the program,. The only exceptions were approximately 
60 first grade students, recommended by the parti cipati ng schools, who started 
at the beginning of the Spanish Reading Program. All the students in second 
grade had been in the Spanish Reading Program, as first graders but had not 
completed the total program. 

Since few students outside the Spanish *Readi ng Program could be expected to 
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• learn to read in Spartish, a control group could not be used. ATI students in. 
the Spanish-.Reading Program participated.^ _the interim testing program and the 
end-of-year testing. 

✓ 1 

Measures •' jr 

7 ' - \ 

A series of seven interim tests* developed 

were used'to measure student progress in thq Spanish Reading Program. Six of 

the interim tests were developed in 1970-71 and revised prior to the 1971-72 

’ . * 

field test. The seventh test was devekiped during 1971-72. " 1 

The \irst interim test, measuring auditory and visual recognition of * 

V 

letters and syllables, was’ used with hand card-punch machines (QRS Machines) and 

pre-punched computer cards. This test was conducted by a Bi lingua,] Project staff 
/ * . 

member Teste two through seven were designed tQ test spelling, ability to read 

Y 

words, and ability. to read sentences. . These tests were printed and required the 

A 

student to respond either by marking an "X" on the Correct ansv/er or to spell 
wprds (spelling td^t only). The tests were administered by the classroom 
teachers. 

The end-of-course test administered to the students during May 1972 was a 
criterion Test constructed by the Bilingual Project staff during 1970-71 and 
revised for the 1971-72 field test. It was necessary to develop a local test 
because no standardized Spanish Reading Test was available. The test was 
adminisfered to the class as a group by the classroom teacher. The test 
consisted of five subtests and a total score. The subtests were spelling, word 
readirig I, word reading II, sentence comprehension and paragraph comprehension. 



by the Bilingual Project staff \ 
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Results Of The Interim Testing Program 

All of the kindergarten and first grade classrooms in the project 
participated in the interim testing program. The second grade classrooms 

• v 

also participated but, because of the small number of students, their test 
results have not been included in this report; Both the kindergarten and 

y 

first grade classrooms grouped their students for Spanish reading 



instruction. As a result, interim tests were given to each group of 



students within 'each classroom as they, completed the reading' booklets. 
Records indicate that eleven of the eigh-teen kindergarten classrooms and 
all twelve, first' grade classrooms had at least one group of students wfio "" 
completed. 'at least seven of the eight Spanish . Readi ng - booklets (booklet 
8 consisted of review activities and special rules. It was not considered 
essential -for completing the program). 

A criterion level of 80% of the students in eadh classroom attaining 
80% correct on each interim test was arbitrarily selected as the goal for 
the interim testing program. However , after reviewing results of previous 
year's testing -and the first iwo interim tests, it was apparent that the 
criterion level should be revised. Consequently the-criterion level has 
been set as 75% of the students attaining 75% correct on each interim test. 

A summary of the percentage of kindergarten students in each classroom 



who scored 75% (or higher) for interim tests 1 through 7 is presented in 






Table I. The results are presented graphically in Table II. The tables 
indicate that 15 of the 17 kindergarten classrooms achic w -ed the criterion on 
T£$t #1 (one classroom did not report). - Similarly, 16 of 18 classrooms 
reached the criterion on Tests # 2 and 3 while 13 of 16 classrooms attained 
it on Test #4. 






21 



SPANISH READING - KINDERGARTEN INTERIM TEST RESULTS 
(Percentage of Students Scoring 75% Correct) • 
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Eight' of the 11 classrooms that reported on Test #5 achieved the criterion while 
the corresponding figures were 6 of 8 classrooms for Test #6 and 6 of 6 class- 

r 

rooms for Test =7. Table II indicates that fewer classrooms (and fewer students 
within each classroom) reported interim test data for Tests 5-7. The primary 
reason? wert.(l) several classrooms had no student groups that completed reading 
booklets' 5-8, and (2) the end-of-school activities received priority over the 
interinvtests. _ 

The first grade classrooms in the project were not given the first interim 
test'because most of the students had compl eted^papt of the Spanish Reading 
Program during kindergarten. (The only exceptions were approximately 60 first 

' t 

grade students who had not been 4n Spanish Reading in kindergarten but were 
recommended for inclusion by’th'e school?). All classrooms were asked to administer 
interim Test #2 through 7. However, several classrooms skipped Test =3 because • 

. their students were ready to begin reading booklet 4 at the start of school.. 

■ * 

In addition, four classrooms did. not administer interim Test #7 because of 

* 

time constraints imposed by end-of-year testing commi ttments* and other end-of- 

school activities. // ' N - 

• * ’ ' * ■ . 1 

A summary of the percentage of f4rst grade students in each classroom 
who scored -75% or higher for interim Tests 2 through 7 is presented in Table 

t * 

III. A graphic display of the percentage of classrooms achieving the criterion 

is pres'ented in Table IV. The tables indicate that 8 of 10 classrooms (80%) 

achieved the criterion of Test n while 4 of 7 classrooms (57*) attain<5dit on 

. Test ~3. Tests #4, 5, and 6 were administered by all first grade classrooms 

(with the exception oi one classroom on Test #4). The percentage of classrooms / 

# 

attaining the specified criterion level o.n these tests were 82% (Test #4), 

83% (Test,#5) and 67% (Test ~6 ) . Finally, Test =7 was administered in 8 
classrooms and yielded a percentage of 63% attaining the criterion. 
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TABLE IV 

SPANISH READING - FIRST GRADE INTERIM TEST RESULTS 
Percentage of Classrooms Attaining Criterion 
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The results of the kindergarten and first grade interim testing programs 
illustrated in Table II and Table IV indicate that the objective of each class- 
room achieving a specified criterion level of performance on each interim test 
was not attained. However, '-the statistics for classrooms is somewhat misleading' 
because some classrooms exceeded the criterion by a large margin while others 

failed by a narrow margin. In addition, some classrooms had more students than 

• > 

others, and the total class percentages obscured these numerical differences. 

For these reasons, total group statistics have also been calculated for both 

the kindergarten and first grade students. 

A set of summary statistics for all kindergarten students is presented 

graphically in Table V. These statistics reveal that over 75% of all the 

kindergarten students participating in the project scored at or above 75% correct 

on each of the seven'ititerim .tests . The table also shows, that the mean percent 

correct, (i.e. average score) was above 75% for every interim test. 

Summary statistics for the total first grade group is displayed in Table 
v 

VI. These statistics indicate, that, with one exception (Test #6), 75% or more 
of all the first grade students participating, in the project scored above the 
criterion on the interim tests. Similarly, the mean percentage correct (average 
score) for the first grade students was 75% or higher for every interim test. 

These total group statistics presented in Tables V and VI reveal that 
the students, when considered as a group rather than by classroom, achieved the 

specified criterion levels. 

V ■ ; 

Results of the End-of-Prpgram Test 

r v 

Fifteen kindergarten and twelve first grade classrooms with a total of 
approximately 720 students participated in the final Spanish Reading Test. 
Although the objective for the end-of-program test limited the number of 
students taking the test to 50 kindergarten and 50 first graders^ a total of 
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TABLE VI 

SPANISH READING - INTERIM TEST RESULTS 
TOTAL FIRST GRADE GROUP - SUMMARY STATISTICS 
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MEAN PERCENT CORRECT FOR THE TOTAL FIRST GRADE GROUP 



599 students actually completed the final Spanish Reading Test (End-of-Program 
Test). This number represents all students who hacf completed the prerequisite 
number of reading booklets. The primary reasons for the discrepancy between the 
number of students in the classes and the number that completed the test were 
(1) early student withdrawal from school, and (2) students who had not 
completed reading booklet 4 were not given the test. 

The End-of-Program Test for the Spanish Reading Program consisted of five 
subtests and a composite score. Average percent correct on, the five subtests 
and the composite score for kindergarten and first grade students are presented 
in Table VII. The table reveals that the students who completed the fewest 
reading booklets made the lowest scores, both on the subtests and on the 
composite score. Since the test was designed for students who had completed 

at least 7 of the 8 reading booklets, they v/ere expected to have the highest 

* ‘ \ • 

scores. These students did score higher on all subtests except the spelling 

* 

subtest at the kindergarten level. ' ,. 

* 

Table VII indicates that the students had the least difficulty with the 
rS \ w SU ^^ eS t ^ orc * s ^ 1nce this subtest contained only words with letters 
and vowel -consonant patterns similar to those presented in booklets 1-5, scores 

„4 . • 

were expected to be high. Subtest 2 (Words II) contained words whose spelling. 

patterns appeared in reading booklets 5-7. Students who had not completed these 

booklets were expected to have lofter scores than students who had. The Table 

also indicates that students who had completed at least booklet 5 had similar 

« . 

scores on the third subtest (Words III). This subtest required the student to 
listen to a word spoken by the teacher then select the word from four choices. 
The subtests on sentence comprehension andi paragraph comprehension and the 
composite (total) scoreH^ the test all had score patterns .which coincided . 

with the number of reading booklets completed by the students. The only 
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exception was'sentence comprehension for first grade students in booklet 5. 
However, since only 15 students were tested at this level, the scores should not 
be considered representative of that level of achievement. 

The objective for the Spanish Reading End-of-Progra'm Test was for 80% of 

the students to attain a^score of at least 80% (Composite Score) on the test. 

Table VIII indicates the degree to which this objective was achieved. All of 
the student groups who completed fewer than 7 of the reading booklets fell below 
the cri teri on 'level . In contrast both the kindergarten and first grade students 

A ‘ ^ 

who completed booklets 7 or 8 achieved percentages higher than 80%. These 

results are compatable with the objectives of the Spanish Reading Program. 
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ENGLISH AS A SECOND LANGUAGE 
» ' 

t ' ' : 

The English as a. Second Language (ESL) Program- of the Region One Bilingual 

i 

Project consists of a two-year sequence of oral Engl ish, lessons. For the purpose 
of this report, the results of the interim testing program and the end-of-year 
tests will be considered separately for the first year (Level I) and second year 
(Level II) ESL Program.- 

s . . 

Objectives for ESL Level I and Level II ' . 1 

t 

1. The project staff developed an ESL Level I interim testing program con- 
sisting of seven Bingo Interim Tests during 1970-71. Each teacher in 
the first (level I) ESL program will administer a Bi-ngo Interim Test to 
her students after the completion of each 15 ESL lessons. A class average 
of 75% correct has been selected as the criterion level for the Bingo 

9 * 4 f 

. Interim Tests . 

1 - 

2. The project staff developed an ESL level II interim testing program con- 
sisting of seven Bingo Interim Tests during 1970-71. Each teacher in the ’ 
second year (level II) ESL Program will administer a Bingo Interim Test 

to her students after the completion of each 15 ESL lessons. A class 
average of 75% correct has been selected as the criterion level for the 

• -4 

Bingo Interim Tests. 

3. The performance of the students who have completed the ESL level I Program 
will.be compared to that of a control group using both pre and post instruc- 
tion assessment. A random sample of students in the level I program and 
the control group will be given a structured interview in lieu of a pretest. 
At the end of the school year the two groups will" be compared on a^post 
test developed by the Bilingual Project staff. The test results, should 
demonstrate that there are no significant differences between the two 



groups of students at the beginning of the year, but that the experimental 

I 

) ’ . * “ . 

group will have significantly higher scores on the post test. 

4. The performance of the students who have completed the ESI level II Pro- 
, gram will be compared to that of a control group using both pre and nost 
instruction assessment. A random sample of students from the ESI level 
II program and. the control group will be given a pretest and a post test 
using an oral language test developed by the Bilingual Project staff. 

The test results should demonstrate'' that the two .groups of student's are 
not' significantly different on the pretest but that the experimental j group 
has significantly higher scores on the post test. ^ * * 

The Students 

Thirty-two classrooms with a total enrollment of approximately 950 students 

« i * * 

participated in either the ESL Level I or ESL Level II program. Eighteen kinder- 
garten classrooms containing about 540 students were in the ESL. level I program. 
Fourteen’ ffFst grade classrooms containing approximately 410 students vyere part 
of the ESL Level II program. Two second grade classrooms participated in the ESL 

I 

Level II program but, because ok, the' small number Of students, were not included 
in the statistical analyses contained in this report. 

The kindergarten students selected to participate in the ESL. level I program 
wetre chosen by the school personnel on the basis of their limited oral English” 
facility. The students in the ESL level II program had completed the ESL level I 
program the previous year. 

Measures 

A series of seven interim tests were developed for each level of the ESL pro- 
gram by the Bilingual Project staff. These tests were designed as group tests to 
monitor student progress throughout the school year. Each of the tests consisted 



of eight items covering language patterns presented in the preceding 15 language 
lessons. The test was administered to a group of approximately eight students at 
one time. Consequently, ail scoring was done on a group basis and no individuals 

scores were calculated. Teachers were encouraged to select students at random 

I ' ” . 

j for testing and to administer a test to only one group. These restrictions were 

necessary in order to avoid using excessive amounts of class time for testing. 

I Achievement tests covering the various language patterns presented in the 

lessons were developed for each level of the ESL Program by the Bilingual Project 
Staff. The tests were developed during 1970-71 and revisedon the basis of the 
results obtained from the 19^0-71 evaluation of the ESL Programs. The tests were 
designed to test only English language structures because the development of sen- 
tence Structure is the primary objective of 'both the ESL Level I and Level II Pro- 
grams. The two achievement, tej/ts, containing 40 and 44 items respectively, were 
designed according to the same basic format and were administered orally via tele- 
j Phone by a member of the Bilingual Project staff. The students responses to the 

... test items were recorded on -tape. The tapes were then transcribed and scored by 

* a Bilingual Project staff member. 

* • 

| Results of the Interim Testing Program 

The interim testing program for both the ESL- Level I and Level II programs 

consisted of seven ihteHm tests.* The tests were designed to be administered by 

| the classroom teachers after every 15 language lessons. The results of the interim 

testing program for each level of the ESL Program are presented bslow. 

r . ' . 

ESL Level I Interim Test Results 

| The interim tests -for the ESL Level I program were administered to groups of . 

. J 7-8 students and yielded only group scores. ' Since individual scores were, not 

I • * ' y 

available, a class average of a 75% correct was selected as the criterion level for 
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' . <; 
each interim test. 

i 

Data presented in Table IX shows the number of kindergarten classrooms in 
which each interim test was administered and the number that attained the 75 % cri- 
terion level. All classrooms achieved the criterion on four of the interim tests 

(Tests 3, 4, 5, and 7) while 16 of 17 classrooms reached it on Test 1. Only on . 

* * 

interim tests 2 and 6 did more than one classroom fail to attain the criterion. 

► 

* 

However, on' test 6, all four classrooms which failed to meet the criterion scored - 

y 

just below the designated level. Consequently, for 6 of the 7 interim tests, all ‘ 
classroom§ were either above the criterion or clustered about it. ' ' 

The average achievement level on the ESL level I interim tests is Summarized, 
in Table. X. The average percent correct for all students ranges from a low of 81% 
(Test ‘6) to a high of 94% (Test 7). However, averages for the majority of the tests 
tend to fall between 85% and 90%. ’ „ 

i ‘ . t 

ESL Level II Interim Test Results > • • 

The ^interim tests for the ESL Level II Program were based on the same format 
as those for the Level I tests and yielded only group .scores . As a result, all 1 

data from^these tests were in terms of percentage correct by classroom. A' cl ass 

> 

average of 75% correct in each classroom was selected as the criterion level for 
each interim test. 

Table XI shows the number of classrooms in which each interim test was admin- 

<. ’ * 

istered and the number that attained the 75% criterion level. The data indicates 
that over 90% of the classrooms attained the criterion on three interim te'sts while 

- a 

approximately 70% reached it on the four remaining tests. An analysis of these 
tests indicated that two classrooms had consistently low test scores throughout 
the school year. These teachers had not devoted the .recommended amount of time 
to ESL activities and had omitted portions of the supplementary (reinforcing) 
activities. 
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LEVEL'' I INTERIM TEST 


RESULTS 






.Number of Classrooms Attaining; 75% Criterion Level 






\ 




- \ 

. 4 

i* 


l 








. NUMBER • 


-'PERCENT 


INTERIM 


TOTAL . 


TOTAL 


Attaining 


ATTAINING 


TEST 


CLASSROOMS 


1 ^REPORTING 


75% CRITERION * 


75% CRITERION 


Test 1 


18 


• 

17 


16 


94% ' 


-Test 2 


* '18 


. 14 


11 


79% 


Test 3 


18 


* 

17. 

j 


17 


100% 


Test 4 

1/ 


' 18/ 


18 ^ 

% 


18 


100% • • 


' Test 5 


18- 

•> 


J 

16 


16 


100% 


Test. 6 


18 •• 


.16 


1-2 


75% 


/. ’ 

Test 7 


18 


9 . 


'9 


100% • 
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TABLE X 

ESL LEVEL I INTERIM TEST RESULTS 
Average Percent' Correct 






(n=232) 

Test 

#1 



(n=165) 

Test 

#2 



(n=184) 

Test 

#3 



(n=198) 
Test- . 
#4 



(,n=163) 

Test 

#5 



' (n=l 58) 
Test ’ 
# 6 



(n=l 07 ) 
Test 
#7 
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TABLE XI 



T 

J 

]' 



ESL LEVEL II INTERIM TEST RESULTS 
Number of. Cl assrooms Attaining 75% Criterion Level 









INTERIM 

TEST 


TOTAL 
CLASS ROOMS 


TOTAL 

REPORTING 


NUMBER 
ATTAINING 
75% CRITERION 


PERCENT 
ATTAINING 
75% CRITERION 


Test 1 


14 


14 


10 


71% 


Test 2 


14 , 


14 


^ 10 


71% 


Test 3 


14 


12 


11 


92% 


Test 4 

V 


14 ... , 

/ 


13 


10 


77% 


Test 5' 


14 


13 


• 12 


92% 


• Test 6 


14 


11 


8 


73% 


Test 7 


14 


8 


8 


100% 
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A summary of the average percent correct on each of the ESL Level II interim 
tests is presented in Table XII. The average percent correct for all students 
completing the Level II interim tests ranges from a high of 94% (Test # 7) to a 
low of 83%. Averages for the remaining five'tests fall between 85% and 90%. 

Results of the End-of-Yea r Tests 

Achievement tests covering all sentence patterns presented U\ the ESL lessons 
at each level of the ESL program were developed by the Bilingual Project staff 
during 1970-71 and revised on the basis of 1970-71 test results. These tests were 
administered to a random sample of students in the corresponding level of the ESL 
program and to a comparable control group. A description of the test procedures 

and the results of the analyses are presented below. 

** * 

ESL Level I End-of-Year Test Results f 

All eighteen kindergarte'n classrooms in the Bilingual Project participated 

, 0 • i 

in the ESL Level I end-of-year test’. Six students were selected at random from 

each classroom at th^beginning of the school year. A total of 108 students were 

selected in September 1971 and 95 were still in school in Ray 1972. These 95 

students constituted the experimental ‘ group for the ESL Level I end-of-year testing 

progra.m. • 

* 

A control group was sel ected. from thirteen classrooms in four different 
school districts during September 1971 . Eight students were randomly selected 

c j • 

from each of the thirteen classrooms for a total of 104 students. At the end of 
th^chool year, 84 of ,the students remained in school. These 84 students com- 
prised the control group for the ESL Level I testing program. 

/ 

The students in the experimental fVoup arid the control group were tested 
^Uj^ng a ten-item structured interview fn September 1971. They v/ere tested again 
in May 1972 using the ESL Level I Oral English Test developed by the project staff 
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TABLE XII ' • 

ESL LEVEL II INTERIM TEST RESULTS 
Average Percent Correct 
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and the Goodenough-Harri s Drawing Test. Finally, a sample of 28 experimental 
students and 27 control students were given the C omprehension of Oral Language : 

A Test of Inter- American Series at the same time the other post-tests were 
administered. . 

The Goodenough-Harri s Drawing Test, a standardized test of general ability, 
was used to compare the experimental group with the control group on general in- 
tellectual maturity. Means and standard deviations for the groups on this test 
are presented in Table XIV. N 

An analysis of variance statistical treatment was. used to compare the two 
groups' scores on the Goodenough-Harri s Drawing Test. Group membership (i.e. 
experimental or control) and sex were the two variables for which scores were 
tested by the analysis. The results of the analysis of variance are presented in 

r 

Table XIII. The statistical test indicated that there were no significant dif-r 

\ * 

ferences -between the experimental group and control group, but that there were 
significant differences between boys and girls. The .experimental and control 
group boys had higher scores than the experimental and control group girls. 
However, the groups were considered comparable in general ability for the purpose 

• * O • 

of the ESL Program. , 

The students' scores on the ESL Level I pretest were also compared using the* 
analysis of variance technique. The results of the analysis of variance are pre- 
sented in Table XV and means and ‘standard deviations for the groups are displayed 
in Table XVI. The analysis of variance indicated that there were statistically 
significant differences between the experimental group cr.d the control group on 
the pretest scores.' An examination of the means of the groups shows that the 
control group boys and girls both had higher scores than the students in the 
experimental- groups. These results indicate that the control group students, 
upon entry into kindergarten, had greater competence in speaking and understanding 






TABLE XIII 

ANALYSIS OF VARIANCE FOR GOODENOUGH-HARRIS 
DRAWING TEST (ESL LEVEL I STUDENTS) 



SOURCE OF 
VARIANCE 


D.F. 


MEAN SQUARE 


* 


F-RATIO 


Group 


1 


298.379 




2.65 N.S. 


Sex 


/ 

1 


510.323 


• • i 


4.54 <.05 


Group By Sex 


1 


6.578 




0.06 N.S. 


Erro.r 


174 


112.514 




- 



TABLE XIV 

MEANS AND STANDARD DEVIATIONS FOR THE 
GOODENOUGH-HARRIS DRAWING TEST 
(ESL LEVEL I STUDENTS) 



EXPERIMENTAL GROUP 



CONTROL GROUP 






GIRLS. BOYS 



Mean « 87.65 
S.D. =11.73 


Mean = 91 .44 
S.D. = 10.32 


Mean = 90.64 
S.D. = 10.67 


• Mean = 93.66 
S.D. = 9.68 
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TABLE XV 



ANALYSIS OF VARIANCE FOR ESI LEVEL I 
PRETEST SCORES 



SOURCE OF 
VARIANCE 


D.F.- 


MEAN SQUARE 


F-RATIU 


Group . 


. 1 


* 113.626 


25.13 <01 


Sex 


1 , 


3.282 


0.73 N.S. 


Group. By Sex 


1 


0.829 


0.18 N.S. 


Error 


175 


4.521 


r 



TABLE XVI 

MEANS AND STANDARD DEVIATIONS FOR 
ESL LEVEL I PRETEST SCORES 



EXPERIMENTAL GROUP 



GIRLS * BOYS 



Mean =3.32 
S.D. = 1 .81 


Mean = 3.45 
S.D. = 2 .24 


Mean = 4.78 
S.D. = 2.20 


Mean =5.18 
S.D. = 2.20 



CONTROL GROUP 



the English language than the experimental group students. This result can be 

% 

explained at least in part by the way children were selected for the experimental 
group. Only those students who, in the opinion of the public school staff, were 
unatjle to function effectively in English were selected to participate in the 
Region One Bilingual Project. Control group students, on the other hand, were 
not grouped according to their ability to function in English. Consequently, the 
control group's scores on the ESL Level I pretest could reasonably be expected to 
be higher. 

.Although scores on the pretest indicated that the experimental group were 

less competent, in English than the control group students, post test results show 

that the experimental group had slightly higher mean scores. The means and stan- 

* 

dard deviations for the post test, presented in Table XVIII', indicate that the 

mean scores for the experimental group boys and girls were 19.45 and 20.39 respec- 

* . ** 

tively, while the corresponding scores .for control group boys and girls were 18.30 
and 17.95. However, the differences in post test scores were not statistically 
significantly (Table XVII). . 

Because of the differences between the scores of the experimental group and 

the control group on the ESL pretest, the pretest scores' were used as a covariate 

in an analysis of covariance treatment of the ESL Level I post test scores.. The 

purpose of the analysis of covariance was to statistically "adjust" the post test 

scores for differences noted on the pretest scores. The analysis employed the 

multiple linear regression model suggested by Bottenberg, et.al. 1 The results 

of thq analysis of covariance revealed that the post test scores were significantly 

higher for the experimental group students after. they had been adjusted for 

^ * 9 

Robert A. Bottenberg, ,et al . , Applied Multiple Linear Regression, 

(AD 413-123; Washington: Defense Documentation Center, 1963), Chapter 5. 



TABLE XVII 



ANALYSIS OF VARIANCE FOR ESL LEVEL I 
POST TEST SCORES 



SOURCE OF 
VARIANCE 


D.F. 


MEAN SQUARE 


F-RATIO 


<? 

Group 


T 


% v 

144.588 


2.02 N.! 


Sex 


1 


/ 

5.872 ' ' 


0.05 N. 


Group By Sex 

% 


1 


18.314 


0.26 N. 


Error 


175 


71.416 
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TABLE XVIII 
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) 


MEANS 

ESL 


AMD STANDARD DEVIATIONS FOR 
LEVEL I POST TEST SCORES 





\ 


GIRLS 


BOYS 


\ 

I 


Mean = 20.39 


Mean = 191.45 


1 EXPERIMENTAL GROUP 

1 


S.D. = 11 .28 
% 


S.D. = A 76 

V 


1, 


Mean = 17.95 


Mean = 18.30 


, • CONTROL GROUP 

/ 


S.D. = 7.31 , 


S.D. = 6.75 


1 % 
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differences in pretest scores. The adjusted means for the experimental group boys 

and girls were 20.66 $nd 21.83 respectively. The corresponding adjusted means for 

the control group boys and girls were 16.43 and 16.81. These results support the 

conclusion that if the students in the experimental group and control had all had 

comparable pretest scores, the post test scores of the experimental group would have 

been significantly higher than those of the control group. 

A subsample of the experimental and control groups was administered a test from 

the Inter-American Series, named the Comprehension of Oral Language . The purpose. 

of this test was to check the validity of the Esl Level I Oral English Test. A 
♦ * 
validity coefficient was calculated between the two tests using the Pearson product 

moment correlation. The validity coefficient was .420, indicating a moderate re- 
lationship. This coefficient, although somewhat low, indicates a substantial area 

I ^ 

of agreement between the two tests. The validity coefficient had been expected 
to - fall near .500 because the two' tests measured somewhat different aspects of 
oral English facility. The ESL Level I Oral English Test was designed to test 

the correctness of oral English sentence structure. In contrast, the Comprehension 

• 1 

of Oral Language Test (Inter-American Series) was designed to test listening com- 

* 

prehension in English. ,, 

In order to ascertain whether the experimental group and control group scored 
•-differently on the Comprehension of Oral Language test, an analysis of variance 

statistical test was performed. The results of the analysis of variance, shown 

• 9 

in Table XIX indicated that there were no significant differences between the two 
groups on the comprehension of oral English. The means for the two groups ir$i- 
cated that both the experimental and control group children scored near the upper 
limit of the test range. Both groups of students were able to comprehend oral 
English as presented in the test. 



\ . - f . TABLE XIX . s 

ANALYSIS OF VARIANCE FOR COMPREHENSION 
OF ORAL ENGLISH (INTER-AMERICAN SERIES) 





FOR ESL LEVEL 


I STUDENTS- 




SOURCE OF 






1 


VARIANCE 


D.F. 


MEAN SQUARE 


F-RATIO 


Group 


1 


4.436 


0.45 N.S. 


Sex 

i 


1 


7.912 


0.81 N.S. 


Group By Sex 


1 


O.Oll 


0.00 N.S. 


Error 


51 


9.820 


« 



TABLE XX 

* 

MEANS AND STANDARD DEVIATIONS FOR 
COMPREHENSION OF ORAL ENGLISH (INTER- 
AMERICAN SERIES) FOR ESL LEVEL I STUDENTS 



EXPERIMENTAL GROUP 



CONTROL GROUP 



GIRLS BOYS, 



Mean = 25.67 
S.D. = 1.63 


Mean = 24.86 
S.D. = 3.74 


Mean = 26.22 
S.D. = 3.70 


Mean =25.47 
S.D. = 3.28 

t 



ESL Level II End-of-Year Test Results 

Twelve of the fourteen first grade clc^ssrooms which participated in the ESL 
Level II Program also participated in the ESL Level II end-of-year test. The two • 
classrooms not in t.lie end-of-year test had Leen designated as migrant classes. 
Because of their abbreviated school year, these two classes had not begun when 
the student sample was selected. Similarly, they had completed t he i r school year 
prior to scheduled post tests in ‘May 1972. 

The experimental group for the ^SL Level II testing program consisted of 70 ' 

students. Six students were selected at' random from each of the twelj/e classrooms 

\ 

and administered a pretest in September 1 971 . The same students were administered 

a post test in May 1972. Only two students who participated in/the pretest were- 

/ 

• not available for the post test. 

* I ' 

A control group consisting of 69 first grade students from twenty classrooms 

. / ' < • 

in eight different schools participated in bo y the pretest and post test phases 

of the ESL Level II Program. These students attended schools with socioeconomic 

■ • ’ / * 

, ^ s 

levels and percentages of^exican-American students similar to those of the schools 

participating in the Bil inguar Project. All control group student's had attended 

■ 

kindergarten and had received some training in oral English. 

The students in the experimental group and the control group were administered 

the E5L Level II Oral English Test as a pretest in September 1971. The same test 

vas administered as a post test in May 1972* In addition, the Goodenough-Harris 

^wing Test Was administered to students in each group in May 1972. 

***■“■■— * 

■ The Goodenough-Harris Drawing Test was administered to the experimental . group 

and control group students as a measure of general a bi 1 ity. The students' scores 

were compared using an analysis of variance statistical treatment. The results 

of the statistical analysis, displayed in Table XXI, ihdicates that there were 



* 



*,1 



I; 



erJg 



* 






/ 



TABLE XXL 

ANALYSIS OF VARIANCE FOR GOODENOUGH-HARRIS 
DRAWING TEST (ESL LEVEL II STUDENTS) 



SOURCE OF 
VARIANCE 



<Group 

Sex 

Group By Sex 
Error 



D. F. • 

. 1 
1 
1 

135 



MEAN SQUARE 
287.311 
231.545 
. 1.533 
111.052 



F-RATIff - 
2.587 N.S. 
2.085 N.S. 
* 0.014 N.S. 



TABLE XXII 



\ 



MEANS AND STANDARD DEVIATIONS FOR 
GOODENOUGH-HARRIS DRAWING TEST 



.1 


| (ESL LEVEL 


II STUDENTS) 


■ 




r 


\ 

' GIRLS 


BOYS 


1 


• EXPERIMENTAL GROUP 

r ■ 


Mean = 93.00 
S.D. = 11,57 


Mean = 95.37 
S.D. = 10.35 


1 

. : 1 


1 .... . 

| . CONTROL GROUP 


Mean = 89.91 
S.D. = 9.51 


Mean = 92.71 
S.D. =• 10.61 



51 



no significant differences 1 due to group membership or sex. In other words, the 
experimental group students and control group students were similar in general 
ability. Means and standard deviations in Table XXII reveal that the scores for 
the- two groups were comparable. 

ESL Level II Oral English pretest scores were analyzed using an analysis of 

variance statistical treatment. The results of the analysis of variance, presented 

in Table XXIII, indicate that there were significant differences between experi- 

• \ 

mental group students and control group studehts on the pretest. Inspection of 

the test score meai^s (Table XIV) revealed that mean scores were higher for both 

boys and girls in the experimental group than for boys- and girls in the control 

group. That is, the pretest scores indicate that the experimental students had 

greater oral English facility than the control students at the beginning of the 

.school year. Further examination o"f thd means reveals that the differences be- 

• * 

tween the two groups were primarily due to the scores of the- experimental group 
girls. Their mean scores were an average of approximately 4 points higher than, 
the experimental boys' scores. 

The post test scores for the experimental and cdhtrol group students, when 
compared to the pretest scores, indicated that both groups had higher average 
post test scores'. . In addition, the experimental groups appeared to have made 
greater gains than the control' group. The pretest and post test means for the 
two groups are presented graphically in Table XXV. The .graph indicates that 
experimental boys and girls had similar rates of gain.. Furthermore, both had a 
higher rate of gain than the control boys and girls. 

The ESL Level II Oral English post test scores showed thg; the students in 
the experimental group again scored significantly higher than the control group 
students (Table XXVI). However, the observed differences in post test scores 
could have been due to differences in pretest .scores. An analysis of covariance 



TABLE XXIII 

ANALYSIS OF VARIANCE FOR ESL LEVEL II 
x PRETEST SCORES " 



SOURCE OF 


. • r 




* 


VARIANCE 


MEAN SQUARE [ 


' D.F. ‘ 


F-RATIO 


Group 


•473.508 


1 


6.631 <.05 


Sex 


V43.884 


1 


2.015 N.5. 


Group By Sex 


Ct 

126.505 , 


1 


. 1.772 N.S. 


.. 


\ 






1 Error 


71 .40| 


, 129 


- 



TABLE XXIV- • 

MEANS AND STANDARD DEVIATIONS FOR * f 

ESL LEVEL II PRETEST SCORES 



C ■ 

' EXPERIMENTAL .GROUP 

i: ' ' ■ ’• 

j CONTROL GROUP 

r ' V ' 



GIRLS BOYS 



Mean = 23.58 
S.D. = 9.03 

f 

i 


Mean = .19.54 
S.D. = 8.24 

« 


Mean = 17.85 
S.D. = 7.71 


Mean = 17.72 
S.D. = 8.79 

0 



i: 
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t '' TABLE XXVI X 

T * 

“ • ANALYSIS OF VARIANCE FOR ESL LEVEL II 

_ - ' POST TEST SCORES 



SOURCE OF 

VARIANCE ■ v MEAN SQUARE . D.F. 



Group 




1,160.064 


1 


Sex 




81 .779 


1 


J 








Group By Sex 




40.179 


1 


Error 




_J70.851 


129 




F-RATIO 
16.373 <.01 
1.154 N.S. 
0.567 N.S. 



. TABLE XXVII 

MEANS AND STANDARD DEVIATIONS FOR 
ESL LEVEL II POST TEST SCORES 



EXPERIMENTAL GROUP 
CONTROL GROUP 

<P 



GIRLS BOYS 



Mean = 27.37 
S.D. = 9.17 

r '■ . 


Mean = 24.77 
S.D. - = 8.40 


Mean = 20.54 
S.D. = 7.67 


Mean = 20,09 
S.D. = 8.36 

' o 



> 
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was performed to determine "if the observed differences in post test scores for 

. The purpose 
post test scores 
employed the 

- 4 O 

multiple linear regression model suggested by Gottenberg, et al . 

The results of the analysis of covariance indicated that significant differ 
ences (°(=.05) remained between the experimental group and control group after 
the post test scores had been, adjusted for differences in'pretest scores. That 

I . ~ 

is, if the experimental group students and control group students had all had 
comparabl e . scores on the pretest, the analysis of covariance suggests that tne 
experimental group would have scored significantly higher on the post test. 



the two groups were the result of differences in pretest scores 
of the analysis of covariance was to statistically "adji 
fdr differences in the pretest scores. The covariate ana' 




C. TRANSITIONAL ENGLISH READING 
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Objectives \ 

1. The Bilingual Project v)i 11 conduct a field test of the Transitional 
English Rep/ring Program developed during 1970-71 to teach native 
Spanish-speaking students to read in English. A stratified random T 

' sample of students -(50 first grade and 50 second grade) will be 
administered a criterion test developed by t,he project staff as a 
post test. A cri terion level of 80% of the students attaining a 
.score of 80% or higher (composite score) has been selected. These 
students will not be compared with a control group because no 
; v comparable cqntrol group is avai 1 able wi thi n Region One. Reading 

» , I 

Programs in schools not participating in the project use the State 
adopted basal readers. Consequently, at the end of the first year 
of reading instruction, the two groups have different types of 
reading skills and cannot be directly compared. 

2. An interim testing program Will be established based on the 1971-72 

revised reading booklets of the Transitional English Reading Program. 

Interim tests will be developed for each of the eight reading 

booklets^ Interim tests will be administered by each, classroom 

teacher upon completion of each reading booklet. A criterion level 

.c . . 

of 80% of the students in each classroom scoring 80% or better on 
each interim test has been selected. for the interim testing program. 

The Students * 

s * ' i 

Tv/enty-four classrooms, containing approximately 700 students, participated 
'in the Transitional English Reading Program during 1971-72. - Fifteen of the 
classrooms v/ere first gfade and nine were second grade. Fourteen of the 

* 
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first grade classrooms had completed the ESL Level I Oral English Program 
during 1970-71 and were enrolled in the ESL Level II Program. In addition, 
these first grade classrooms were completing the Spanish Reading Program, 
which they had begun in kindergarten. In contrast, all the second grade ' 
classrooms had completed both the ESL Level I arid ESL Level II Programs and 
the Spanish Reading Program in previous grades. 

Measures 

The objective for the Transitional English Reading interim testing 
program was to develops series of eight interim tests. Only five interim 
tests were 'developed and administered during 1971-72. Each of the interim tests 
was printed and consisted of reading comprehension and spelling subtests. 

The reading subtests for tests 1-4 consisted of a word, phrase, or sentence 
with four pictures to which the students responded by marking an "X" 'on the 
picture corresponding to the words’. On test 5, students were also presented 
written sentences and short paragraphs and required to select written 
responses. The spelling subtest presented a picture and the students 
responded by spelling the word or by supplying missing letters to a word. 

The end-of-course achievement test for the Transitional English Reading 
Program, developed by the Project staff, was administered during May 1972. 

It consisted of subtests on spelling wprd recognition, sentence comprehension, 
and paragraph comprehension. The test was administered to the class as a 
group by the classroom teacher. 

Results Of The Interim Testing Program ' 

All twenty-four of the first and second grade classrooms in the Transitional 
English Reading Program participated in the interim testing program. Both 
first and second grade classrooms grouped their students for English Reading 



instruction. As a result, interim tests were given to each group of students 
within a classroom after they completed the corresponding reading booklet. 
Records indicate. that thirteen first grade and eight second grade classrooms 
had at least one group of students who completed six of the reading booklets. 
Consequently, interim test data is available for all five of the interim tests. 
Test data for it. he first grade and second grade classrooms are summarized in 

Tables XXVII I /and XXX, respectively. 

\ 

A criterion level of 80% of the students in each classroom achieving 80% 
correct on each interim test was arbitrarily selected as the objective for 
the interim testing program. However, after reviewing results of the pilot 
program, the criterion was revised. The criterion level was subsequently set 
as 75% of the students attaining 75% correct on each interim test. 

„ A summary of the percentage of first grade students in- each classroom who 
scored 75% or higher for interim tests 1-5 is presented in Table XXVIII. The 
results are presented graphically in Table XXIX. The tables indicate that 

eleven of the fifteen classrooms (73%) attained the criterion on Test #1 and 

/ 

fourteen of the fifteen (93%) reached it on Test 2 2: All fifteen classrooms 

/ 

(100%) achieved the criterion on both Test #3 and Test #4. Finally,, on Test 

#5, twelve classrooms administered the test and ten (83%) reached^ the 

/ 

criterion. 

A summary of the percentage of second grade students in each classroom 
whq scored at least 75% correct for interim tests 1 through 5 is presented in 
Table XXX. A graphic display of the percentage of classrooms attaining the 
criterion is presented in Table XXXI. The tables indicate that five of the 
seven classrooms that administered the test reached the designated level on 
Test #1 ( tv/o classrooms did not administer Test 21).» For Test 2 2, eight of 
the nine- classrooms achieved the criterion. For the remaining interim tests, 
all classrooms achieved the criterion (one classroom did not return Test 25). 
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TABLE XXXI 
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TRANSITIONAL ENGLISH READING - SECOND GRADE INTERIM TEST RESULTS 
Percentage of Classrooms 'Attaining Criterion 




Test #1 Test #2 Test #3 Test #4 test ft 5 
(n=7) (n=9) (n=9) (n=9) (n=8) 
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The results cf the first and Second grade interim tests indicate that 

I 

the objective of each classroom achieving a specified criterion level of 

performance on each test was not attained. However, one problem was found 

in working exclusively with class percentages. Some classrooms had more 

students than others, but total class percentages have obscured these | 

numerical differences. For this reason, total group statistics have ^5efen - 

calculated for both the first and second grade groups. 

A set of summary statistics for all first grade students is presented 

in-Table XXXII; These statistics reveal that over 75% of all the first grade ' 

students participating in the project scored at or above 75% correct on each' 

of the' five interim tests. The table also f shows that the mean percent . 

\ 

correct (i.e. average score) for the first gra<Je‘group was. above '75% for ' 

‘ 

every interim test. 

Summary statistics for the total second grade group is displayed in Table 

o 

XXXIII. These statistics indicate that on every interim test *75% or more of 

the students in the second grade Transitional English Reading Program scored 
* * 
abovb 75% correct. Similarly, the mean percentage correct (average score) 

for the second grade group was greater than 75% for every interim test. 

i • 

Results Of The End-of-Proqram Test 

Fifteen first grade and nine second N grcide classrooms containing a total 

of approximately 700 students participated in the Transitional English Reading 

Program in 1971-72. Although the performance objective for the end-of-year 

testing program had limited the number of students taking the test to 50 first 

graders and 50 second graders, the test was actual ly. admi nistered toV total 

» 

of 490 students. The change was made possible because a group reading test 
was developed to replace the individual test used in 1970-71. The number of 



'64 




r 







f 




O 



65 



TABLE XXXIII 

' TRANSITIONAL ENGLISH READING 

TOTAL SECOND GRADE GROUP - SUMMARY STATISTICS 
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.students taking the test represents all students for whom the test was considered * 
appropriate. The primary reasons for the discrepancy .between the number of 
students in the program and the number that completed the end-of-program test 
' were (1) early student withdrawal frtjm school and (2) students who had not 
completed reading booklet 5 were not given the test. 

The end-of-program test for the Transitional English' Reading Program . 
consisted of five subtests and a total score. The average percent correct for 
each of the five subtests and the total score for both first and second grade 
stlJ dents is presented in Table XXXIV. Scores for first and second grade 
students were similar for all subtests and' the total score. The tab.le also' 
indicates that scores were directly related to the number of books completed. 

That is, students who completed reading booklets 1 through 5 had lower scores 
than those who completed additional booklets. This result was expected because 
the test contained material from each of the first seven reading booklets. 

However, it should be noted that very small numbers of students, were tested 



at some-levels (i.e. grade 2, booklet 6) and the results-ifiay be somewhat 
unstable for these groups. '• ’ .. 

The first subtest consisted of a set of pictures and required the students 
to write the name of the object in the picture. The table shows that student ’ 
scores ranged from a low of 55% to a high of 79% correct. Since the words 
were selected primarily from' book* 1-5 (75% of^the items), all students were 
expected to score above 50% on this subtest. 

The second subtest consisted of a series of items which contained a 
picture and three sentences. The student was required to select the sentence 
which corresponded to the picture. Scores on this subtest ranged from 72% 
to 92%. This distribution of scores is somewhat 'higher than -expected since . * 

half the items contained word, patterns which had not been presented in reading 
booklets 1-5. .. 
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Subtests 3 and 4 consisted of a series of words and pictures. Students 
were asked to match the word with its corresponding picture. Subtest 3 
contained only words from reading booklets 1-4 while subtest 4 contained 
words from booklets 4-3. The results of the analysis indicate that, as 
expected, scores on subtest 3 were high for all students. Scores on subtest 
4 were lower for students who had completed fewer reading booklets, although 
not as low as expected. 

Subtest 5 contained three short paragraphs (4-5 sentences). At the end 
of each paragraph there were several statements for the students to complete. 
Students responded by checking the word which correctly completed the statement. 
Although this subtest was considered the most difficult, 'scores ranged front 
48% to 87% correct, depending upon the number of reading booklets t he 

students completed. 

. ,/ 

Total scores for the achievement test ranged from 69% to 87%. Students 
in first grade had scores which closely corresponded to those of second grade 
students who had completed the same reading booklet. This result would 

4 

indicate that maturity was not a significant factor for these students. In 
addition,' it was noted that all second grade students had completed both the 
ESL Level I and ESL Level II Programs prior to second grade, while the 
first grade students were taking the ESL Level II Program concurrently with 
Transitional English Reading. The results of the achievement test .indicate 
that it is not necessary to complete the ESL Level II Program before beginning 
the Transitional English Reading Program. 

The objective for the Transitional English Reading Program stated that 
80% of the students would achieve a score of at least 80% (total score) on 
the final achievement test. Table XXXV shows the degree to which this 
objective was achieved. All the students who completed fewer than 7 of the 
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Second Grade 8 138 110 80% 



reading booklets fell .25 or more percentage points below 'the criterion level 
(students in second grade, booklet 6 were not considered because only 8 
students were tested). However, second grade students who completed booklets 
7 or 8 and first grade students who finished booklet 8 either attained the 

ii 

criterion or fell within one percentage point of it. In addition, the first 
.grade students who finished booklet 7 scored only 8 percentage points 
'below the criterion. The analysis of the final achievement test indicate 
that the results are within acceptable limits of the 1 objectives for the 
Transitional English Reading Program. 
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D. SOCIAL EDUCATION 



The Social Education Program of the Region One Bilingual Project Consists 
of a two-year sequence designated as Social Education (Le-'el I) and Social Educa- 
tion (Level II). The Lovel I program contained six units in English and two 
units in Spanish, while the Level II program contained only units in Spanish.- 



Objectives 



1 



i 



A set of Social Education units in English and Spanish were pilot tested 
during 1970-71. The project staff will conduct a field test of this 
Level I Social' Education Program during the 1971-72 school year. The 
field test will include a random sample of at least 50 students in the 
project (25 first grade and 25- second grade) and 50 control group stu- 
dents (25 in first grade and 25 in second grade). The evaluation in- 
strument will be a Social Education Test (Level I) developed by the 
project staff. Additional measures will be the Brown Self Concept 
Referents Test (pretest and post test) and the Goodenough-Marri s Drawing 
Test. 

2. An interim testing program based on the eight units of the Level I 
Social Education Program will be established. Interim tests. will be 
given by each classroom teacher upon completion of each of the Social 
Education units. An average of 75% per classroom has been selected 
as the criterion level for the interim tests. 

3. A Level II Social Education Program, will be developed and pilot tested 
in 10 second grade classrooms during 1971-72. 

4. An interim' testing program based on the units to be developed for the 
Level II Social Education Program will be establ i shed . Interim tests 
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will be administered by the classroom teacher. A ciass average of 75/i, 
correct has been selected as the criterion level for the interim tests. 

i \ 

The Students 



• Thirteen first grade classrooms , containing approximatcly^T50 students 
participated in toe Social Education Level I Program. All students in the prooratn 
had completed the ESL Level I Program and were enrolled in the Spanish Reading 
Program and the ESL Level II Program. 

Two first grade classrooms and nine 'second grade classrooms, with'a total 
enrollment of approximately 300 students participated in the Social Education 
Level II Program. Students in the two first grade classrooms were the same age 
as the second grade students., but had attended a beginners class in 1970-71. 

Some of these students had attended kindergarten prior to entering the beginner 
level and 'some had not. Consequently, these, two first grade classes contained 
students who had already attended school for one or two years. The first grade 

students had completed ESL Level I and Social Education Level I and were en- 

* 

rolled in ESL Level II and Spanish Reading. The second grade students had com- 
pleted, ESL, Level I, ESL 'Level II, Spanish Reading, and Social Education Level . I . 



Measures 

The Social Education Level I Program consisted of five units presented in 

English and three units presented in Spanish. Interim tests used in the 1970-71 

pilot test were found to contain a number of' ambiguous and invalid items. As 

a result, an interim testing program was not implemented during the pilot test. 

Similar problems were encountered during the field test conducted in 1971-72. 

* 

A number of d/ifferent types of interim tests were devised and tried out in the 
classrooms, but none were considered appropriate for measuring the concepts 



presented in the Social Education Level I units. Because of the lack of success 
• ( 

in developing valid, interim tests, classroom observation by the Project Director 
and Social Education Suporvi'sor/Consul tant was used. 

, Problems similar to those described for the Level I interim tests were 
encountered in the Social Education Level II Program. Since the primary pur- 
pose of the pilot test was to determine the effectiveness of individual units 
of instruction, direct classroom observation by the curriculum writer was con- 
sidered most appropriate. As a result, no interim tests or end-of-year achieve- 

* “S 

ment test were constructed for the Social Education Level’ll Program. 

An end-of-year achievement test was developed for the Social Education 
Level I Program using the most successful techniques devised for the interim 
testing. This test consisted of 38 items about concepts presented in the Social 
Education Level I units. The test was administered orally by a project staff 
member to individual students. The students responses, were recorded on tape. 

The tapes were then transcribed and scored by a Bilingual Project staff member. 

f 

R esults Of The End-Of-Program Test For Social Educ a tion Level I 

All thirteen classrooms in the Social Education Level I Program partici- 
pated in the end-of-Program achievement test. A total of 42 students we re 
selected for the sample (three students were randomly selected from each class- 
room).' 

A control group consisting of 21 students was selected from four schools " • 
not participating in the project. The control schools were selected because 
the socioeconomic levels and percentage of Mexican-American students were com- 
parable to the schools in the Bilingual Project. 

Students in the experimental group and the control group were administered 
both the Goodenough-Harris Drawing Test and the Social Education Level I achieve- 
ment test. Both tests were given by a Bilingual Project staff member in May 1972 



The Goodenough-Harris Drawing Test, a standardized test of general ability, 
was used to compare the experimental group and control group on general into! lee- 
* tual maturity. An analysis of variance statistical Vcechnique was used to com- 
pere the scores of the two groups. The results of the analysis, presented in 
Table XXXVI, indicated that there were no significant differences between the 
experimental and control students' scores. Means and standard deviations for 
the groups are presented in Table XXXVII. 

The experimental group and the control group were also compared on the 
Social Education Level I achievement test. The results for the analysis of 
variance of these scores are presented in Table XXXVII. The analysis indicated 
that the experimental students had significantly higher Social Education test 
scores than the control group. There were no significant differences between 
scores for boys and girls in either group. 

Although the analysis indicated that the experimental groups’ scores were 
significantly higher, art inspection of the means for the two groups revealed 
that the differences were less^than had been expected. The mean for the. experi- 
mental groups' scores was 24.60 (25.45 for girls; 23.82 for boys) while the 
mean for the control group was ’09. 38 (20.18 for girls; 18.50 for boys). An 
analysis of the Social Education test used to measure achievement indicated 
that it dealt primarily with facts rather than the concepts presented in the 
Social Education units. Since the test measured information which is generally 
learned by all students, the experimental groups' scores were not very different 
from those of the- control group. 

- v 

/ 

V 
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TABLE XXXV i 



ANALYSIS OF VARIANCE FOR GOODENOUGH-IIARRIS " 
DRAWING TEST (SOCIAL EDUCATION LEVEL I STUDENTS) 

SOURCE OF 



VARIANCE 


D.F. 


MEAN SQUARE 


F- RATIO 


Group 


1 


/ 

140.005 

A 


1,17 N.S . 


A 

-Sex 


1 


311 .45t) 

\ 


2.61 N.S. 


Group By Sex 


1 


29.309 


0.25 N.S. 


Error 


, 53 


119.498 





TABLE XXXVII 

MEANS AND STANDARD DEVIATIONS FOR THE 
GOODENOUGII-HARRIS DRAWING TEST 
(SOCIAL EDUCATION LEVEL I STUDENTS) 





GIRLS 


BOYS 




Mean =88.89 


Mean = 95.24 


> EXPERIMENTAL GROUP 


S.D. = 11.85 


S.D. = 12.07 < 




Mean = 93.64 


Mean =97.00 


-CONTROL GROUP 


S.D. = 7.53 


S.D. = 10.06 | 

1 




TABLE XXXVIII 

AIIALYSIS OF VAK1A7ICE FOR SOCIAL EDUCATION 
LEVEL I EliD~0F 7 PROGRAM TEST . 



SOURCE OF 



VARIANCE 


LLl 


MEANJQUA_RE 


F-RATIO • 


Group 


. 1 

/ 


391.359 


13.94 <.01 


Sex 


I 


' 38.344 


1.37 N.S. 

« 


Group By Sex 


I 


0.009 . 

• 


0.00 N.S. 


Error 


59 


28.074 





TABLE XXXIX 

MEANS AND STANDARD DEVIATIONS FOR 
SOCIAL EDUCATION LEVEL I END^OF- PROGRAM TEST 



EXPERIMENTAL GROUP 



GIRLS BOYS 



Mean = 25.45 
S.D. = 5.34 


Mean = 23.82 
S.D. = 5.52 


Mean = 20.18 
S.D. = 5.31 


Mean = 18.50 
S.D. = 4.65 



CONTROL GROUP 
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Bilingual Project' Admi nistrati ve Staff 
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BILINGUAL PROJECT STAN' 



PROJECT DIRECTOR - A. R. Ramirez , 

Twenty years experience as teacher, principal, curriculum director, and 
college instructor; directed Title III Project which developed F.S’L level !. 
and Level II Rock materials used in the Bilingual Project. This is his 
third year as Project Director for the Region One Bilingual Project. 
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j 

]' 




] 
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EVALUATOR - Ricardo R. Chapa , 

Experience includes classroom teacher, principal, director of 
private school in Honduras, and consultant for a Bilingual Project in 
Lansing, Michigan. This is his second year with the Bilingual Project. 

EVALUATION CONSULTANT- Thomas H. Linton ' . ' 

Experience includes internship with an educational research organization 
(Teaching Research, Monmouth, Oregon) and research associate with ERIC/ 

' Cress; holds a doctorate in Educational Administratiori/Research. This 
is his second year with the Bilingual Project. - 

PRIMARY SUPERVISORS - Corina Lozano, Oralia Rivas, Dora Soto and Lydia Miller 
All have experience in teaching at the primary ’level and are bilingual. 
Three of the. supervisors have been with the project since its inception. 



CONSULTANTS ON CULTURAL ENRICHMENT ACTIVITIES - Carolina Garza and Beverly Pritchard 
Both supervisors have experience in primary level teaching. One is a 
certified te'acher in Mexico with a one-year internship in Montessori 
teaching methods in Italy. 



ARTIST/ILLUSTRATOR - Virginia Bruce ' 

Experience includes primary level teacher and commercial illustrator. 
This is her third year with the Bilingual Project. 



SITE AIDES - Gloria Campos, Mary. Sandoval , ..Maria Enriques, Viola Vera and Elva' 
Garza 

Each has had experience either as a teacher aide or in the control and 
accountability of materials. 




c 
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APPENDIX B 
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Materials and Equipment 
for 

Bilingual Project Components 
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SPANISH READING 



INSTRUCT I ORAL MAT ER I ALS 



Teachers Manual 

Alphabet Trays and Loose Letters 
Vocabulary Ca''ds • 

Sound-Letter Correspondence Cards 
Workbooks (8), "Sonidos , l.etras y Palabras 11 - 
Bingo Game 



INSTRUCTIONAL MATERIALS 
— > 

Teacher’s Plan Book 
Manual with 128 Language Lessons 
Filmstrips Synchronized with Records 
Puppets and Masses • 

Song Recordings 

Audio-Flashcards - 

Objects for Teaching Lessons 

a. Small Objects Bag < 

b. Puppet Bag- »■ 

* c. Big Object Bag & 

1 1 d. Kitchen Objects Bag 

e. Paper Pack 

Bookle'ts 

a. Illustrations of Audio Flash Cards 

b. Index of Sentence Patterns 

c. . Language Card Index 

• d. Mask Booklet 

e. Puppet Booklet 

f. The First Week 



MEDIA EQUIPMENT NEEDED 

Tape Recorder ■ (EFI or Bell & Howell Machine for Language cards) 
Overhead Projector ' 
FilmVtrip Projector/Record Player 



MEDIA EQ UIPMENT NEEDED 



None - 



ENGLISH AS A SECOND LANGUAGE LEVEl I 



\ 
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SOCIAL EDUCATION LEVEL I 



I IJS1TU.ICT I P: i A L JIATE RIALS 

Teacher's Manual 
Uni ts 

Transonrencies 
Audio Tapes 
Fi lmstri ps 
Pi cturcs 

Cutout Picture Snoots 

Student Works hoots 

Class and Scnool Photograph 

Costumes 

Stories 



MEDIA EQ UIP MENT HE EDED 

Filmstrip Projector 
Tape Recorder 
Overhead Projector 



SOCIAL EDUCATION LEVEL II 



INSTRUCTIONAL MATERIALS 



Teacher's Manual 

Uni ts 

Maps 

Checks, Deposit SI ins 
Audio Tapes 
Fi lmstri ps 
Costumes 
Stories 



, MEDIA EQU I PMENT NEEDED 

Filmstrip Projector 
Taoe Recorder 

7 

i 

l 

1 
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APPENDIX C 



Status of Objectives for 1971-72 





A. Review of Activi ti eu for 1971—72 



1 . Program Ikniagom^nt 



a. The decree to which the 1971-72 prcduct/procoss objectives have been 
attained : 

(1) Staff Development (Product Objectives) 

(a) Objectives 1 - As 

The project director collected informs t ion fror.i parents 
(Parent meetings, parent survey), teachers (weekly commentaries., 
teachers meetings) , project staff (supervisor reports, staff 
meetings), and evaluative data to identify the 1971-72 program 
objectives and performance objectives for the Region One 
bilingual Project. Staff needs were identified and qualified 
personnel hired. The organizational structure for the project' 

. was. explained to the project staff at the first formal staff 

meeting. 

(2) Staff Development (Process Objectives) 



(a) Objectives 5 and 6: 

The responsibilities of each staff member were discussed and 
delineated at the first formal staff meeting. Supervisor/ 
consultants were assigned to program areas as specified. 

However, the areas of Spanish Reading and Spanish Language 
Arts were assigned to a single supervisor /consul tant . Conse- 
quently, only four supervisor/consultants were assigned to 
the project . 

(b) Objective 7 : 

. Site aides were employed at* each of the five .schools partici- 
pating in the project. Responsibilities were explained by the 
project director prior'to employment 

(c) Objective 8 : 

Mother aides were provided in four of the five project schools 
by the Bilingual Project, they were employed in classrooms 
which lacked teacher aides . Although all project schools have 
changed mother , aides . at least once, only two of the four schools , 
have changed every twelve weeks as specified. in the objectives. 

The other schools have been reluctant to change mother aides 
because the teachers did not want to assist in training new aides, 
school principals did not want to bring new mother* aides into the 
school during the school year, and the supply of qualified mother 
aides was limited. A total of forty-five (45) mother aides have 
ta! en part in the program. 



(d) Objectives 9 and 10: 






AH' staff positions wore filled prior to August 1, 1971." The 
professional qualifications of each staff member are on file in 
the Region One Education Service Center personnel files. • 



O 
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(c) Objective 11,: 

A communications network consisting of weekly commentaries l:y 
the teachers, ore. 1. reports by sui.«erviscu:/eonsylLnnts , formal 
and infon:n.l. stuff meetings, and written reports by the project 
e va 1 u; i L o i: i. 1 1 d s u y c r v i s o r / c o n s u 1 1 a n t s ; Th e t; o : ■ u : vi c a !. i o n s y l • m 
was explained to the staff members , in a staff z.ceting prior to 
'’the beginning of the school year. 

( f ) Obj acti ves 1 2 ~ 1 5 : * 

A Lime schedule for evaluation activities was completed and 
posted in the directors off ice by September 1, 1971. Formal 
time schedules' for materials development and staff development 
{ activities wore not established, because of the multiple* res- 
ponsibilities assigned to the director and t*hc supervisor/ 
consultants, strict scheduling of these activities could not 
be accomplished. Inventory schedules* for controlling materials 
disseminated to the schools were established and maintained 
by the supervisor /consul tant in each program. 

(g) Obje ctive 16: 

Progress charts were established for each classroom and have 
been updated weekly. 

(3) Community Involvement (Product Objectives) 

(a) Objective 1 7: 

The community involvement program has included a variety of 
activities designed to inform parents, the general community, 
local university students, and other professional persons of 
the purposes and activities of the Region One Bilingual Project 
Formal meetings between the project staff and parents were 
conducted in tv;o of the participating schools-. Parents in a 
third school were invited to observe their children and become 
familiar with the Bilingual Program. Another school held an 
open house to inform the public about bilingual education. 
However, parent committees were not organized because needed 
inputs into the program were already available. 

The project director has made presentations to the Region One 
Education Service Center Board and to the Region One Joint 
Committee (composed of all superintendents in Region One) . In 
- addition he has met at least twice with each superintendent of 
the five schools in trie project. The project staff has also 
made presentations to the members of the school board for two 
of the project schools. 

Two 30-minute television presentations have been shown on a 
local television station. The shows included an explanation 
of the programs contained in the Bilingual Project and live 
classroom demonstrations of program activities. In addition, 
a 15-minute summary of the Bilingual Project was presented on 
state-wide television program sponsored by Senator John Tower. 



I 



Dissemination activities to bilingual projects:, university 
groups, and public school personnel not: in t:hc Region Cue 

Bilingual l'roji ct have inclinl--'^ -i /oo\’ . 

L ions ci !i<] workshops . 



tiiii Ly -throe (33) prescuLa 



i 



Inter views with ninety-four (94) parents of children in the 
pi eject hive been conducted . Results of the parent i nf.orvi evs 
indicate that 952 (a 9) have a positive attitude toward the child 
learning to roe a ’ n Spanish, while 12 (1) war, not sure that .the 
program was good, and 42 («'t) did not cnk.cn t . When the parents 
were asl.ed tneir opinion of tnc: methods used t:o teach oral English, 
the percentages of favorable and unfavorably: V espouses were 952 
• and respectively, while la did not have an opinion. 

*9 

(ft) Community Involvement (Process Objectives) ' 



(a) Obj ective 1 8: 

Mother aides were hired and placed in classrooms that did not 
have teacher aides. All project schools have changed mother 
aides at least once. However, only two of the four project 
schools employing mother aides changed aides every twelve weeks. 
Ihe other schools did not wish to change aides as often during 
the school year.' A total of forty-five (45) mother aides have 
taken part in> the program this year. 

(b) Obj active 19 : 

Site aides have acted as community liaison persons and have' also 
been instrumental in obtaining mother aides to participate in 
the project. Oral reports to the project director and consultants 
provides a continuous source of feedback from the school and the 
community . 



(c) Objective 20 ; 

A random sample of parents from each community was selected and 
interviewed during February and March 1972. Interviews were not 
conducted during October because of limitations in time and 
personnel. The results of the survey are presented in Community 
Involvement (Product) . 

(d) Objective 21 ; 

No negative feedback from parents or members of the community 
have been reported to the project director. 



(5) Regional Coordination Activities 
( a ) 1 Obj ectives 22 - 31 ; 

This component was cancelled due to limited participation of 
other bilingual projects 



An analysis of successes and failures in meeting performance objectives. 

The project was successful in meeting most of the objectives for staff 
development. A staff was assembled and organized as specified. The 
only major modification va s the assignment of one supervisor/consultant 
to both the Spanish Reading Program and the Spanish Language Arts Program. 
Site aides were hired and assigned to each school. Mother aides wore 



1 

J 

? 

! 



i 

j 



t 

l 



I 

■> .. 

hired , trained , and a:;:;ira.:d to classrooms. However , two of the school r, 
ch&ugcd aides r.t the end of the first 12 voeks but requested dull t lu.v be. 
allowed to kev.ji the iiu;: a i uofi Jor the. a oi Liu- school yen/. Tin. rc-Wicns 
for the request;. were tin: I changing aides; Curin'.*, the year caused c:o;C\. .*. dm 
in the c] 'lf'.sroon :; and it was d.i j : j.ctiit to t ir.a enough qualified mother aides 
to change every IT w?e!u. . 



The Community Involve: . *n t prov.ram was .sue 
interest* and acceptance of the bilingual 
were not Gianni ;:..a , covuiii cation with pa 
ways. Telt-vision proved to he an oifectj 
classroom application of project goals, 
from formal r.eorinns, conmonts to teacher 
a formal i n t or v i c v . 



cesr ful in ma into i ni:*g parent: 
Project:. Althou ;ii parent ccv. mit Loos 
rents was accompli: died i.n several 
ve neons of dcricnsiirn t i ng tl-V. 
Feedback, from parents was received 
s aiu! site aides, and response to 



The project was also successful in disseminating information to public school 
and university personnel, not associated with the project. The number of 
presentations and in-service programs has increased significant! ly over pre- 
vious years. Ip* addition, requests lor materials by other bilingual projects 
and public schools has increased. 

c. Modification of Long Range Objectives 

' have dropped the plan to provide inter-project coordination between 
Bilingual Projects within Region One. 



d. Modifications or Refinements of the Program 

Wc will again attempt to increase community involvement through a Community 
Developer. A part-time Staff Development Coordinator v will be employed to 
plan all staff development activities. 



e. General Assessment 

L 

Now that there are classes v/ho have completed three years of intensive 
bilingual language arts instruction we have been able to demonstrate, to 
administrators and board members the great gains that are effected. 
Continued exposure on T.V. has created public awareness of the potential 
for this revolutionary (in the U.S.) method of instruction. 
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Spanish Reading 



n, llio d c g I o o to which .1 9 7 1 "7 2 pri.diic t/:u*ocoss 
(1) Instruction {¥* rdu”t; 01: j oc Li ves) 



( l b i ee t i v o s have b e on at L a i n c c! : 



(a) 



Objective 32: 

A fieM U the level 1 Spanish Rending program has been 

conducted in 18 kindergarten and j 2 first grade classrooms v;.i i.h 
a to tel. enrol hiicuL o I appLoxiniatoly S/3 students during the 
1*9 71—/- school year. Post-last data are presented in the lu.'tly 
of this report. 



(b) Objective; 33 : 

The level 1 Spanish Reading prop, ran was not completed by any of 
the parti ci pa t in g c 1 a s s rooms d m* i n 1970-71, Cons o f j vie ntlv , class 
rooms scheduled to enter the. Spanish renounce Arts p v or, ran .in 
September 1.97.1 were rescheduled in drder to complete the level I 
program. It is now anticipated Chat the level I Spanish Reading 
program will become a 1 1/2 year program covering kindergarten 
and the first semester oi first grade. Since the Spanish Lnnguag 
arts program was designed to reinforce concepts in the level 1 
Social Education program, it will be merged with 'the level 1 
Social Education program next year and v/ill not be field-tested 
as a separate program. 



(2) Instruction (Process Objectives) 



(a) O bjective; 34; 

Students in the level I Spanish Reading program are spending at 
least thirty (30) minutes per day in Spanish reading activities 
as required. Each teacher in the Spanish Reading program sub- 
mitted a schedule of daily teaching activities to the project 
evaluatof* by October 15, 1971. 

(b) Objective 35: 

An interim testing prografh based on the eight reading booklets 
in the Spanish Reading program has been established. Interim 
tests 2, 3, 4, 5, and 6 have been revised on the basis of the 
1970-71 interim testing program. Interim test 7 was developed 
this year. Interim tests have been administered by the class- 
room teachers upon completion of each Spanish reading booklet. 
Results of the interim testing program are presented in Section 
A of this report, 

(c) Objective 36 : 

Teacher commentaries are submitted weekly by each project teacher. 

(d ) Objective 37 : 

The <end-of-yenr Spanish Reading Test was revised on the basis of 
the 1970-71 testing program and the revisions made in the Spanish 
reading booklets. 
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• ivo tc m purch*!.- 




v c 1 * ■: e j : s c r < l n : ;d , pm* c : ' ;i s e » i 
1 ;:s; rooms . Approx i:.\n LcJ y :• 




[jiV;: m r % \r.\ not cp./'vlc tod by the l.indar- 

fC'iil lowed in Liu jlrst grade c.L- v. arms . 
i.cn Ai ts program bar. had Lo bo 

sh Ri ndiag p ruprnm was completed. In 
■ r ,unwe t :: pyogy am \ rn s do s i ennd Lo 
need i.n the level I Social rkiucnt ion 
par.ish heading ’si:?’ j la. Therefore, the 
o.rnr.i will not bo ; j eld- tested during 
It. will bo. worked v:i.th the level I 
:nul i laid- ton ted as a part of that 



(3) Development of Materials (Product Objectives) 

(a ) Object : i ve 4 1 : 

The toaciier training program for the Spanish Reading program 

has boon partially developed. Video tapes have been completed 

as scheduled. In addition, a^35 MM slide scrips has been completed. 

(b) . Obj ective 42: 

A supplementary reading list, for the Spanish Language Arts program 
has not been developed. Since one of the purposes of the reading 
scries was to reinforce concepts introduced into the Social Educa- 
tion program, this series will bo developed as a part of the 
Social Education program. 



Items to be induced in the teacher training program were identi- 
fied on the basis of data from the first and second years of the 
Spanish Reading program. . Dr. Gloria Massey has served as consul- 
tant for the program. A worteshop for training kindergarten 
teachers to use the Spanish Reading program was conducted during 
the summer of 1971. Although the audiovisual materials to be 
included in the final teacher training package had not been 
developed at that time, the workshop provided additional data 
for subsequent program development. 



(c) Objective 43 : 

Spanish reading booklets :V7 and i l S were completed during the 
summer of 1971. Booklets ?/l, 2, 3, 4, and 5 have been revised 
on the* basis of the 1970-71 field test. 



(4) Development of Materials (Process Objectives) 



(a) . Objectives 44 a nd 45: 
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or new mother aides) and 



(b) Obj ec L ive 50: 

Tu Lorn were placed in tv;o of the five participating schools, A 
tutor \;a$ already available in another school, The other schools 
have not requested a tutorial program . 

( c ) Ob jo c: tivc 5 1 : 

baseline data on the teachers in the Spanish Reading program 
indicate that 21 of the 30 teachers are bilingual * while 3 can* 
speak some Spanish but are not fluent. One teacher in the 
program ^cannot speak Spanish. The. teachers who do not speak 
Spanish fluently have made arrangement's for other teachers to 
teach Spanish Reading to their students. 

(6)' Staff Development (Process Objectives) 

(a) _ Obje ctive 52 :■ 

A two-day in-service workshop covering all components of the 
Bilingual Project was conducted on August 24 - 25, 1971. 

The workshop was attended by 41 of the 42 project teachers. 
Teacher aides did not attend the workshop, 

(b) Obje ctive 53 : 

Mother aides attended workshops or received individual *ass is tance 
from the Spanish Reading supervisor /consultant during the- first 
two weeks of school. Mother aides who were’ hired for second and 
third 12- week periods curing the school year received training 
from the Spanish Reading supervisor /consultant . 

(c) Objectives 54 and 55 : 

Only one supervisor/consultant has been assigned to the Spanish 
Reading component. She was assigned responsibility for the first 
year Spanish Reading program. The supervisor/consultant hds 
visited each classroom weekly as scheduled. However, oral 
reports to the project director followed by written bi-weekly 
reports have supplanted the supervisor report used last year. 

(d) Objective 56 : . 

The project director has met with the teachers participating in*» 
the Spanish Reading program four times during thk* school • year . V 
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be completely mcVjieJ with the I Social Education pro;v.':.;n and v.’ill bo 

field- to?: tod a s a part, of that program during the 19/bi- 7 11 school year. 

•iS 

flic objectives dealing with materials development have? been met for the 
Spanish Reading program. All eight read in;’ booklets have been completed 
and the first five booklets .have been revised. Objectives concerning 
development: of teacher training materials have been partially met. Work 
is continuing on these objectives. 

Objectives for staff development were generally met. Although there was 
no preservice training for teacher aides and mother aides, workshops 
were presented by the Spanish Reading supervisor /consultant during the 
first two weeks of school. 

c. Modification of Long Range Objectives 

Spanish reading is established as a viable instructional program in the 
kindergarten. It now appears that no more than three-fourths of the course 
can be covered in nine months. In the future, the last part of the course 
will be taught in first grade. 

d. Modifications or Refinements of the Program ■ 

No modifications, other than revisions already made, are expected in the 
Spanish Reading Course, 

e. General Assessment 

Success in Spanish Reading has given the children in the project greater 
confidence as well as prerequisite skills needed to succeed in English 
residing. Second grade children write in either language with ease. 

* The popularity of the materials has been gratifying. Bilingual programs 
throughout the U.S. have been purchasing them all year. Next year a 
publisher will market them commercially nationwide, assuring even greater 
use of the instructional package. 
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uout;! and 



•(b) 
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(c) 



oruv-hmuhv 2 co:i'. rf j .i lu.jo h Vs were r-t v selected and 
Int 01 j i’V.vd >'! j tit'.;' be:: Inning 01 the. year to.dotcriv.j’iH: their 
ability to speak and comprehend ora] hnglish. A nost-to.se 
of oral hnp.l j xli ability and tin; (iocdenough-liar r.is Draw j ng 
Test was ad mi ni stored to the. supple during April. 1972.. (So: 
Section 15 of this report.) 

. v 

O bjec t iva 60: * 

J he l-.Sh level I. i program lias been f ield-testod' in 14 first 
grade and 2 second grade classrooms- for a total enrollment of 
approximately 475 students. The testing procedure for pre- 
nnd post- testing lias boon modified to include only first grade 
students . (only 2 second grade classrooms are in the level II 
program). Pretests were administered to 75 experimental and 
77 control students in September 19//1. A post-test of Oral 
English and the Goodenough-IIarris Drawing Test was administered 
to the experimental and control- groups in April 1972. (See 
Section 15 of this report.) 

Objec tive 61: • 

IMie Iransitionai English Heading program was field-tested in 
15 first grade and 9 second grade classrooms with 9 a ‘lotal\ 
enrollment of approximately 675 students. No pretests were •' 
*. " administered to these students, since it was assumed that they 

did not know how to read in English. A post-test was adminis- 
tered., in April 1972., (See Section C of this report.) 

(2) Instructions (Process Objectives) 

i 

(a) Obj ective 62 : 

Teachers in the iiSL level. J program "submit tod teaching 
schedules to the project evaluator during October 1971. 

* The schedules indicated, that the level I classrooms were 

spending the suggested time allotments (2 1/2 to 3 hours) 
on the 'LSD activities. . 

(b) Objec t ive 6 3: ’ ' 

interim tests have been administered in the ESL level I class- 
rooms after completion of each 15 lessons. .Results of the’ 

•interim testing .program are presented in Section B of this 
report. 
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le.ssons. Restilts of the interim testing program are available 
in Section B of this report. 

(g) Objpr.fi. vc 68: 

Teacher eon mentor ies lmvo been {submitted weekly. by each teacher 
in the level II ESL program. ' 



(h) Objective 69: ^ 

The Oral 'KngLi.nh Test (level TI) has been revised on the bas:'j 
of results obtained during the 1970-71 testing program. 

(i) Objec tiv e 70 : 

Students in the ESL level II program have written stories as 
a regular part of their ESL program. Samples of this creative 
writing have been transcribed by the project staff. 

( j ) Objective 7 1: 

Students in the Transitional English Reading program arc- 
spending approximately 30 minutes per day. Teacher schedules 
were submitted to the project evaluator in October 1971. 
Teacher commentaries have been submitted weekly. 

(k) Object ive 72 : 

An interim renting program has been established for. the 
Transitional English Reading program: Results of the interim 

testing program are available in Section C of this report . 

(l) O bjective 73 : 

Teachers in the Transitional English Rending program have sub- 
mitted teacher commentaries ear]] week. ■ 
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(b) , 0b « . o 1. 1 ve 7 r ; : 



The 1 e-iC'icv *s manual for ESL level 1 an: 1 level II ha:; not 



been revir.vd beca-nso no la.- jcr rc/v i pious v^re needed, 



(c) Oj >J act i yyy : ’ 

The teacher train J ng program for i.’ST. level J . rind level II has 
b e en p a r t i all y cl e. v v 1 c* pod . Slid • . and v 1 d cola p e s h a v e been 
developed, but the program has. not been completed. 



(d) Object. i vc 77 : f 

The eight Transitional English "Reading booklets were not ’ 
completed dui lug the 1970-7] school year. Booklets 1. through 
5 were completed last year, while booklets 6 through 8 vert 
completed this year. Booklets (\ and 5 'were revised on the 
basis of feedback from the 1970-71 pilot tesl. 



(e) Ob jeotlvc 78: ’ 

Inter in tests have been developed for 'reading booklets 1 
through 5. The criterion tost to bemused' ns a post-tes*t 
was revised * as' scheduled. 



(f) Objectiv e 79 : 

A second year Transitional English Reading program was not 
developed this year because the level I program was not 
completed during 1970-71 as scheduled, and staff personnel 
were not available to work on both the level I and level 11 
programs simultaneously. 



(g) O bjective 80 : • 

Since the development of the level i' Transitional English 
Reading program bad to be completed this ycrar, development of 
a teacher training program has been delayed, however* slides 
and videotapes- have been produced and work will continue' 
during th~ summer. 



(4) Development of Materials (Process Objectives) 



(a) Objectives 8 1 and* 82 : 

■ Vocabulary lists for two reading series have been compiled and 
cross-checked' with the vocabulary lists for the ESL program. 

In addition, vocabulary wordr. appearing in the Transitional 
English. Reading program but not in the ESL level I program 
have been inserted in the level I lessons. 
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(b) ' v 

Three scripts -urn! a sbricSt of slide pictures % !\v/c .been pn 



(c) 






ducctl for the teacher training program. However,' the program 
has* not: boon M put together" yet. 



0 1 yj «: ' c 1 1 y c s fi 5 •'. vwt • » 

Although sot.v- revision/; of the Transitional English Reading 
program Stave iu on made (bookUi s A and 5), 1:5: c; tine needed ,to . 
complete the 3 booklets has* decayed the revision of Che • 

other booklets. Consequently , ■ a consultant has not bo. on hired 
to t.c.vjew.a^'! evaluate suggested revisions. * ' ’ 

(d ) Ob j ect:?- ves'^S ?. an d S3 : , 

The* project director cancelled the objectives dealing; with 
s computer search of vocabulary of basal readers because of a 
change in state adopted textbooks. 

(c) Oh j qc t iv o 89 : 

A second year reading program, Transition to Basal Reading, 
was scheduled for development this year-. However, because of 
# the tine needed to complete the Transitional English Reading 
program, the development: of the seco’nd year program has been 
rescheduled for the 1972-73 fiscal year. . 

(f) Objectives 90 and 91 : ' 

Videotapes have been made, but must be edite^l and assembled. 

A sound film has been made and* is being edited. However, 
scripts for the teacher training program have nol been 
written. 



(5) Staff Development (Product Objectives) 






r* 



(a) Ob jective 92 : 

The plan for preservice and in-service education training con- 
sisted of a preservice ^workshop in August for teachers and 
teacher aides, in-service workshops during the first two wfeeks 
of school for mother aides (repeated every 12 weeks for new 
mother aides), and individual assistance for tutors. 
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(b) Objective 93 ; 

Supervisor /consul 
the Transitional 
classrooms in the 
not visited every 
program, the less 
’ 0 a week while the 
every two weeks . 
consultant has vi 
project director 
reports. 



tants were assigned to the ESL program and 
English Reading program. Due to the number of 
ESL program, the supervisor/ consul tant . has 
classroom weekly. Consequently, in the ESL 
experienced teachers have been visited once 
experienced teachers have been visited once 
The Transitional English Reading' supervisor/ 
sited each classroom weekly. Reports to the 
have been oral, followed by written bi-weekly 
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(6) Staff Dove l.o p* :ii? n t: (Process Objectives) *, 4 

i 

(a) Ohjectivos 94 and .93; 

A two-day i ^-service workshop* -covering ;tll components of the 
Bilingual Project was conducted on August 24-25, 1971. The 
’workshop v:as af.to:i?U'.c! by 41 of the *4 2 project teachers, 

Tcadier aides and mother aides did not attend the workshop. v 
Motlie;: aides cK tended workshops or received Inciividuat^r^is-^ 
tancc ffon the Si!:>ervi.£*or/con«ultao. t during the school year. 
Ira j rein A was repeated at. J. 2 week intervals for pcwly emploved 
- mother nJides. * * • . 



(fa) Ob j ec t .1 v c r> 9 *3 an d 97: ’ - • . 

*J’he supervisor /consultant for ESL has visited each classroom 
at least bi -weekly during the school year. Because of the- 
number of classrooms in the ESL program, only the less ex- 
perienced teachers could be visited vceklv. The supervisor/, 
consultant for Transitional English Reading has visited each 
classroom weekly as scheduled. • 

* . , ** 

(c) Objective 98 ; 

-Although bi-monthlv meetings were not held as scheduled, the 
project director has. net with the teachers in both* programs t 
four times^.during the year, 0 



An analysis of the successes and failures in. meeting performance objectives. 

Interim test data indicate that from 70% to 100% of the classrooms have 
achieved the criteria. These results suggest that it is not realistic to 
expect all classrooms to achieve the criterion on >^ach- interim test. Records 
of progress indicate that 30 of the 35 'classrooms xn the two programs com- 
pleted at least 90% of the lessons during the year. 



Interim test data, from the Transitional English Reading program indicate' that 
from 70% to 100% of the classrooms have achieved the criterion. Again, the 
results indicate that it is not realistic to expect all classrooms to achieve 
the criterion on every interim test, \ 

Development of materials has* not progressed as rapidly as expected in either 
the ESL program or the Transitional English Reading program! The teacher 
training programs have not been' completed although work is continuing. The 
second year Transition to Basal Reading will not be developed this year 
bemuse the development of the first year Transitional English Reading 
program has^ taken more time than anticipated. ' & 

. t 

Staff development objectives for the ESL program and Transitional English 
Reading programs have generally been met. Teachers in the ESL program have 
not been visited weekly by the supervisor/consultant because of the number 
of classrooms. However, less experienced teachers have been visited ono^or- 
more times per week as needed. 



* 









V 








c. Modif icatioa of Lone; Range Objectives * v * 

No. .change in the objectives* fox* the ora]. ESL program is anticipated, 

d. Modifications o\* Kofinemevits of the Program 

No modifications are expected in the ESL course. 

e. General Assessment' S . , 

Acceptance of the tv:o RUCK Kits nationwide is verified by the sales 
records of the distributor of these -materials,. The Melton Kook Company 
• of Dallas. There are nov; over 1200 classrooms in all parts of -the* 
country using the ESL lessons .and activities. 
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f\ . Social Education 
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• a^. The • decree -to which 1971-7?. product./ process objectives ha/ f c beon 

•attained. • 

(1) Instruction (Product Objectives) 

(a) Object ive 99: ^ 

The level 1 Social Education program has been f Leld-tostirJ i‘a 13 
first fernde • clnssroows with a total enrollment of approximately 
y 375 students. No pretesting was done in September • because - a test 
had not been developed. In addition, the Brown Self ^Concept 
Referents vms* no t % administered because it/was concluded 'that the 
• test would nbt yield information* of significance to the project, 

# A post-test and the Goodenou&h-Jlarris Drawing. .Test was .administered 
. in Ap 5 .il 1972. (See Section D of* this report.) 

(b) .. Objective 1 00: 

* A level Unsocial Education program is being developed and 

pilot*- tested in 2 first grade and 9 second grade classrooms 
with a total enrollment of approximately 300 students. , Since 
the materials are -being developed tliis year, ho pretesting, 
was planned. A post- test has not been devc3.oped.fo-ir this 
program. • * , 

, • . * ‘ • • 

(2-) Instructicn (Process Objectives) 

(a) .Objectives 101 and 105 ; / 

The students participating. 'in level k and level II programs ’ 
have spent an average of, 30 minutes‘*per day in activities 
related to the program^: * ' < 

' (b) Objectives 102 - 10A; 103 -and .107 : . . 4 

* Interim te^tjng programs have not been developed in either' 

the level I or level) II Social Education programs. The end- 
of-year test for the level I Social Education was’ revised 
on tlie basis of the 1970-71“ test results. . 

(3) Development; of Materials (Product Objectives) 

* . • 

’v (a) Objective 108 : 

The level 1 Social Education program has been revised this 
yea^. The first unit, which was presented in English last * 

year, was re-written in Spanish.- One additional Spanish unit * 
has been' revised. None of the other 5 English units have been 
1 revised. 

• # 

(b) Objective 109 ; ^ 

Interim tests have not been developed for the level I Social , 
Education program. 'Several types of tests have been writteri 
and pilot- tested ,• but *no satisfactory format has b*cen identified. 
The primary difficulty has been to find a technique of testing 
which will differentiate knowledge of facts from ability to 
, apply concepts. . 
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(c) Obj ective 1.1 .0: . • ' • *' 

A level it Social Education program wap. developed this 
year. I he level IT. program consist s' of eight unit*. all 
written in S'panish. ’ ' . 

<d) Obje ctive 111/.- \ v ’ 

A teacher Lr “ ini »? the ic-.Ci I and level II Social 

Fa u cat ion program* har. not been- developer] . This objective 
IjP-s^ccn 'postpoiiod until next year. however , data pertainin'* . 
to the teacher training arc tiled with the project evaluator" . 

9 * * 

Development of Materials (Process Objectives) ' * v 

(a) Obj ect ive 112 : . . % • 

» .Revisions in the level I Social Education units were r.iade on 

the basis of feedback from the teachers and from classroom 
observation by the Social Education supervisor/consuitaht. < 

The first unit, "First Days •in School",' was revised and traits-’ , 
la ted into Spanish on the recommendation of the teachers. 

Minor revisions were also. made in the second Spanish unit. 

(b) Object i ve 11 3 1 * - 

Supplementary reading materials for the level I Social Fducation 
program include stories written by' the project- staff and commercial 
story books in Spanish. The project staff has written six short 
stories to reinforce concepts introduced in the level I Social 
Education units. A total of 39 titles have been purchased as 
reinforcement for both the Spanish Reading program and the Social 

ucation program. Spanish writing activities consist of periodic 
creative writing assignments. • , t 

. A • 

(c) Objective 114 ’ : * * sL. ’ ' 

Interim tests developed by the Southwest Educational Development 
Laboratory were discontinued last year because they were not Con- 
sidered valid. .Consequently, satisfactory interim tests have not 
been developed for the level I Social Education program. Several 

b types of tests have Deen written and pilot-tested, but none of the 
tests were considered valid. Group testing was not satisfactory, . 
and individual tests have been difficult to design, because* of the 
concepts being tested. Test development activities will .continue 
until a satisfactory format for interim testing is identified. 

(d) Objectives 115 and 116 : 

The level 11 Social Education program was developed as 
scheduled. The program has been modified in that all units 

tl e JlT Cn l ^ n PaniSh and UnitS developed by the South' 

T W T 10nal Devel °P mcnC Laboratory will not be used. 

The level II program is designed to follow the level I 
program fhe-iove 1 I program presents the individual in the 

• fionshinc ie c ‘° u Vel 11 P r °g»-am deals with group interrela- 
tionships.. Six short stories have been written to reinforce 
the concepts presented in the level II units. Creative 

sc - heduled Periodically as a planned activity ' 
within the program, J 
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(e) Gbj cut ivoa_Il"/_ * 

^iVofoY^VjTjt of 'c^^:^Tnrv training; program in Soc: al Education 
has been postponed until next. year. However, cli i»svoo..i tenchv.t s 
'v’ho- par c ic-ipaled in the program during the 1970-. 1 school .year 
, . vc>«e : interviewed during the. summer • of .IS'71 and ti cir coaanrribs 
filed with (ho project evaluator. . . 



(5) Staff Development (Product ’Objectives) 



*v 






(a) . Obje ct ive # .<19 : t . ‘ ’ 

.The plan "for preservire and in-fiervicc training consisted of . 
a preservice workshop in August fpr#-fecar.uors and tcncueV aides, • 
' in-service wort-shop; during tlie first two wee* as c f school fov 
mother aides (repeated every 12 weeks for. new not her aides) , and 
individual assistance for the tutors. 



M* 
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(b) Objective 120 : ' 

‘A supervisor /(consultant has been assigned for the Social. Education 
program. ThcVsuporvisor /consultant has served* the'dual function 
of assisting qlnssroom teachers and writing' for* the level II Social 
‘ Education program. Oral reports to the project director followed 
* .by written, bi-weekly reports have replaced the supervisor report 
used last year. . . . 

% * 

(t>) Staff Development (Process Objectives) * » ■ 

(a) Objective 121 ; * 

A ■ two-day inner vice workshop covering all components, of the 
* ‘ Bilingual Project was conducted on August 24-25, 1971. The V 

workshop was attended by 41 of the 42 project tetchers*. Teacher 
aides and mother aides did not attend the workshop. 

. . *» •* • 9 

' * ■ 

(b) Objective 122 : • « . 

Mother aides attended workshops or* received individual assistance 
from the Social Education supervisor/consultant • Training sessions 
were conducted as new* mother aides were hired. 



(c) Objective 123 : * 

The supervisor /consultant served a dual role of assisting class- 
room teachers and writing for the level II Social Education program 
Consequently, she. did not observe in each classroom once each week 
**as scheduled, * 

• , . 

(d) * Objective 124 ; . • 

The project director has met with the Social Education teachers 

• periodically, although not bi-monthly, throughout the year. 

• • 

An analysis of the successes and failures in meeting performance objectives. 



Materials development activities have progressed satisfactorily for the 
Social Education program. Development of supplementary materials and 
revision of the level I Social Education program have been accomplished. 
The level II is presently being written and. is expected to be, completed 
by the end of the fiscal, year. 

♦ 
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The r-ont 'Serious probiea en;ounjLc.rocI within the Social Lhhu^Lica pragma 
h ns been the devc Loprr.eut of inter im true! find .acyiievcrient tnlvv for i.in 
level 1 and Jowl II ^roe/ra.-.-s . Tests of factual kv.ov.l edge irlvn- yu'UUvi. 
'little v.eelUl rbcul the program and testy, of the^v ;• rtr. 

prosen led in the.* progrir:. 1 ; have proyod-dif r f cvlt / to construct, TV.-; 
.c!evelop::nt: will continue* as yriunvy objecrivc: r c^r the Social houcaVion 
component for the school vear. 



Staff dove loprvent activities have been limite/i because Lh*^ Social i'iuc:: t ion 
§upo.rv j.cor/consulcani: hau traction ad both, as a writer and a consultant.;*^ 
the teachers, ikvvver, ..observation in the. project c.i era.? ootis 'indicate chat 
the program is being used as plcn;rw*d by the prcjeeL staff, 

V * * « • 

Modification of Lops Range Objectives . • — 

The social educatiolvcour.ee has evolved into an nil-purpose, multi-media , 
cross-discipllvo course .Vaught in Spanish. -Originally it ims intended to 
be taught in Eugl ish also. In. the future the review of the. lessons will be 
in English but all of the. instruction will be in Spanish after first grade. " 

the content .will include economics, ethics, anthropology, ecology*, history, , 
geography, music and drama, • # 

\ . ^ . * , v . * ; • • 

Modifications or Refinements of the Program 

All instruction wi1,l be in Spanish. ’ > 

, ’ ^ - * 

General Assessment * * • 

' ' • • * ,■ 
This course is r the most /popular one with the children. They, hr. opporturilit 

to express their feelings in the roles they play. They are given problems to 

be solved by the group instead of by each individual... These r. .•imperative 

efforts, applied to realistip situations related to humhn&survi- a.l, provide 

.die ’children experience in tjie basics of interpersonal relations. 

• 

We have been unsuccessful in developing adequate test * instruments for th’> < 
course. Our purpose *is to prepare the child to interact well with others 
and to understand the motivating factors that shape our lives'. We cannot 
seem to^ find any way to..measure ^whether or not the children are acquiring 
these skills and concepts. ’* *• 
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